-- Logs begin at Tue 2022-08-30 13:59:44 UTC, end at Tue 2022-08-30 15:06:50 UTC. -- Aug 30 14:35:31.986728 dv-cinder-828805-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 14:35:31.995295 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 14:35:31 2022] *** Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: nodename: dv-cinder-828805-5-iscsi Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: machine: x86_64 Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: clock source: unix Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: pcre jit disabled Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: detected number of CPU cores: 4 Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: current working directory: / Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: detected binary path: /usr/bin/uwsgi-core Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: your processes number limit is 47680 Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: your memory page size is 4096 bytes Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: detected max file descriptor number: 2048 Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: lock engine: pthread robust mutexes Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: thunder lock: enabled Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 14:35:32.000207 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 14:35:32.038350 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: Python main interpreter initialized at 0x563666e1f9c0 Aug 30 14:35:32.038350 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: python threads support enabled Aug 30 14:35:32.038350 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: your server socket listen backlog is limited to 100 connections Aug 30 14:35:32.038350 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: your mercy for graceful operations on workers is 90 seconds Aug 30 14:35:32.038910 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 14:35:32.038910 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: *** Operational MODE: preforking *** Aug 30 14:35:32.039105 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: *** uWSGI is running in multiple interpreter mode *** Aug 30 14:35:32.039105 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: spawned uWSGI master process (pid: 112140) Aug 30 14:35:32.039314 dv-cinder-828805-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 14:35:32.039902 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: spawned uWSGI worker 1 (pid: 112141, cores: 1) Aug 30 14:35:32.042674 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: spawned uWSGI worker 2 (pid: 112142, cores: 1) Aug 30 14:35:32.042674 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 14:35:32.720833 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:35:32.778614 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:35:34.450179 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:34.450179 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: from cryptography.utils import int_from_bytes Aug 30 14:35:34.450976 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:34.450976 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: from cryptography.utils import int_from_bytes Aug 30 14:35:34.455167 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:34.455167 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: from cryptography.utils import int_from_bytes Aug 30 14:35:34.455792 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:35:34.455792 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: from cryptography.utils import int_from_bytes Aug 30 14:35:37.001135 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:35:37.001966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:35:37.001966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:35:37.002165 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:35:37.002409 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:35:37.002792 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.003117 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.003432 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.003747 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.004115 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.004421 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.004748 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.005070 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.005395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.005651 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.005963 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.006283 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-5-iscsi {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.006608 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.006911 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.007213 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.007528 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.007827 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.008081 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:35:37.008743 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.008865 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:35:37.008983 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.009099 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.009257 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:35:37.009477 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.009593 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:35:37.009785 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:35:37.009904 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.010094 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.010211 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.010432 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.010550 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.010907 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.011124 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.011307 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.011453 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.011670 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.011930 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.012265 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.012566 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.012863 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.013173 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.013487 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.013783 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.013783 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.014585 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-5-iscsi {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.014861 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.015445 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.015739 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.016076 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.016363 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-5-iscsi {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.016612 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.016800 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.017031 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.017230 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.017434 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.017660 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.017854 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.017854 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.018209 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.018405 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.018584 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.018827 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.019073 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.019260 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.019459 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.019666 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.019666 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.020067 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.020359 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.020548 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.020740 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.020911 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.021087 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.021284 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.021463 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.021601 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.021793 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.021924 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.022040 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.022164 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.022358 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.022547 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.022728 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.022909 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.023104 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.023303 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.023505 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.023710 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.023904 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.024119 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-5-iscsi {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.024325 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.024325 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.024712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.024905 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.025098 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.025301 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.025506 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.025699 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.025931 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.026110 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.026311 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.026600 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.026799 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.026975 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.027159 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.027360 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.027562 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.027756 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.027940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.028164 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.028164 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.028527 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.028791 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.028998 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.029184 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.029371 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.030152 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.030606 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.030833 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.031029 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.031225 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.031415 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.031608 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.031798 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.031798 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.032217 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.032412 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.032652 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.032824 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.033012 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.033182 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.033346 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.033512 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.033673 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.033837 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.034014 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.034189 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.034352 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.034518 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.034685 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.034859 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.035041 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.035208 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.035385 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.035562 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.035739 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.035922 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.036124 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.036291 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.036455 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.036616 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.036793 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.036974 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.037153 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.037320 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.037483 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.037483 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.037810 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.037990 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.037990 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.038298 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.038463 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.038624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.038798 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.039031 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.039193 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.039357 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.039523 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.039691 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.039877 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.040134 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.040303 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.040470 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.040805 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.040973 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.041155 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.041155 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.041456 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.041629 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.041797 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.041969 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.042144 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.042304 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.042465 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.042644 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.042808 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.042970 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.043149 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.043313 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.043480 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.043644 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.043817 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.043991 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.044183 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.044363 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.044538 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.044716 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.044891 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.045061 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.045283 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.045458 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.045622 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.045808 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.046008 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.046283 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.046445 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.046614 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.046781 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.046945 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.047109 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.047372 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.047541 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.047706 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.047885 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.048088 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.048253 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.048435 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.048598 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.048757 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.048927 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.049161 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.049335 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.049510 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.049673 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.049835 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.050012 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.050175 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.050348 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.050511 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.050678 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.050998 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.051164 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.051325 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.051505 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.051669 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.051835 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.052091 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.052255 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.052412 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.052590 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.052762 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.052926 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.053090 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.053244 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.053404 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.053576 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.053738 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.053911 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.054088 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.054250 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.054410 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.054581 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.054764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.054924 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.055081 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.055259 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.055423 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.055605 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.055794 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.055958 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.056172 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.056172 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.056497 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.056661 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.056822 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.056982 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.057155 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.057347 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.057523 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.057697 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.057869 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.058046 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.058208 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.058369 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.058541 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.058701 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.058862 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.059032 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.059254 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.059418 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.059610 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.059782 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.059955 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.060142 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.060302 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.060485 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.060657 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.060657 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.061285 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.061458 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.061622 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.061801 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.061964 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.062128 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.062334 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.062506 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.062668 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.062846 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.063009 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.063178 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.063341 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.063495 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.063659 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.063837 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.064026 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.064187 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:35:37.064375 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.064548 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.064749 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.064929 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.065094 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.065258 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.065426 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.065589 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.065757 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.065947 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.066127 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.066310 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.066473 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.066632 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.066801 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.066965 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.067136 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.067299 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.067464 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.067633 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.067812 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.067973 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.068212 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.068395 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.068572 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.068739 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.068914 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.068914 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.069307 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.069459 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.069616 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.069783 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.069954 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.070111 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.070268 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.070436 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.070602 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.070878 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.071041 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.071219 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.071510 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.071676 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.071845 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.072058 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.072221 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.072382 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.072542 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.072702 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.072887 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.073077 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.073264 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.073457 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.073629 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.073824 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.073824 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.074202 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.074394 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.074394 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.074757 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.074955 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.075156 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.075344 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.075533 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.075717 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.075896 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.076164 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.076354 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.076552 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.076739 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.076911 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.077086 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.077274 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.077475 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.077654 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.077836 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.078024 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.078628 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.078807 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.079006 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.079189 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.079445 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.079639 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.079821 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.080018 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.080213 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.080405 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.080591 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.080774 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.080954 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.081157 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.081352 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.081556 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.081863 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.082051 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.082051 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.082426 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.082609 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.082788 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.082965 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.083148 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.083338 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.083553 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.083748 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.083919 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.084139 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.084327 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.084546 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.084756 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.084756 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.085103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.085277 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.085460 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.085676 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.085864 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.086059 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.086240 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.086433 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.086622 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.086826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.087012 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.087201 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.087395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.087595 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.087786 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.087991 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.088326 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.088326 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.088680 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.088880 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.089069 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.089272 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.089534 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.089719 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.089925 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.090126 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.090327 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.090506 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.090711 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.090901 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.091099 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.091289 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.091496 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.091675 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.091885 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.092255 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.092463 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.092659 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.092858 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.093142 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.093403 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.093597 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.093782 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.093965 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.094147 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.094332 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.094520 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.094701 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.094701 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.095078 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.095276 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.095467 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.095656 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.095846 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.096082 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.096306 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.096513 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.096706 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.096894 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.097084 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.097260 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.097471 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.097660 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.097865 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.098055 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.098247 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.098429 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.098627 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.098814 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.099001 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.099194 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.099388 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.099647 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.099839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.100046 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.100235 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.100439 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.100628 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.100832 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.101026 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.101200 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.101366 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.101557 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.101750 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.101940 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.102122 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.102441 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.102626 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.102913 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.103117 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.103320 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.103514 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.103707 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.103898 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.104247 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.104456 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.104650 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.104837 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.105027 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.105219 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.105408 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.105620 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.105806 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.105993 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.106183 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.106383 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.106592 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.106797 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.106985 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.107176 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.107363 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.107549 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.107900 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.108239 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.108423 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.108609 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.108795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.108990 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.109195 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.109386 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.109577 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.109840 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.110038 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.110220 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.110422 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.110610 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.110796 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.111003 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.111193 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.111381 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.111594 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.111789 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.111978 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.112255 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.112466 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.112772 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.112986 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.113180 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.113370 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.113561 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.113752 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.113941 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.114146 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.114146 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.114146 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.114677 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.114868 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.115072 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.115261 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.115438 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.115621 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.115799 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.115977 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.116200 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.116373 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.116576 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.116770 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.116961 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.117151 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.117351 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.117533 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.117720 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.117907 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.118087 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.118282 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.118485 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.118683 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.118883 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.119075 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.119261 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.119465 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.119655 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.119900 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.120127 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.120313 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.120497 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.120710 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.120901 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.121092 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.121286 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.121479 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.121868 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.122075 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.122260 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.122439 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.122630 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.122944 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.123153 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.123419 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.123614 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.123749 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.123877 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124026 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124169 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124313 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124445 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124564 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124681 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124807 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.124925 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.125040 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.125171 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.125354 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.125550 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.125757 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.125909 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.126030 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.126155 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.126273 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.126438 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.126575 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.126690 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.126853 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127035 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127224 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127360 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127503 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127623 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127724 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127849 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.127966 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128151 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128279 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128397 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128513 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128629 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128744 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128744 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.128973 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.129148 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.129335 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.129509 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.129635 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.129763 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.129927 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.130070 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.130246 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.130429 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.130615 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.130777 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.130914 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131041 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131160 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131285 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131403 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131539 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131668 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131794 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131911 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.131911 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.132160 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.132292 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.132420 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.132537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.132653 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.132763 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.132887 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133225 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133343 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133483 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133607 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133732 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133863 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.133981 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.134097 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.134213 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.134378 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.134557 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.134746 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.134953 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.135113 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.135250 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.135376 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.135520 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.135645 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.135763 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.135881 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.136017 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.136148 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.136352 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.136490 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.136645 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.136805 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.136989 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.137178 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.137382 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.137510 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.137627 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.137745 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.137854 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.137971 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.138113 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.138234 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.138401 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.138554 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.138554 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.138900 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139026 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139144 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139260 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139398 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139557 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139705 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139824 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.139988 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.140189 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.140305 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.140436 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.140580 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.140763 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.140940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.141063 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.141063 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.141292 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.141410 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.141540 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.141707 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.141869 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.142054 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.142234 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.142234 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.142597 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.142789 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.142950 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.143088 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.143312 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.143444 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.143581 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.143699 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.143814 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.143930 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144062 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144205 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144337 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144456 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144583 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144701 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144817 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.144928 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145102 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145226 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145345 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145460 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145576 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145700 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145825 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.145825 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.146102 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.146229 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.146348 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.146480 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.146480 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.146762 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.146894 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.147041 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.147206 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.147470 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.147657 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.147849 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.147983 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.148153 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.148284 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.148404 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.148520 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.148636 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.148753 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.148868 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.149044 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.149190 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.149353 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.149492 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.149614 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.149796 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.149921 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.150090 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.150210 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.150335 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.150492 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.150694 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.150835 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.150978 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.151099 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.151216 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.151333 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.151496 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.151678 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.151859 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.152115 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.152242 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.152359 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.152491 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.152612 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.152612 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.152871 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.153025 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.153199 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.153446 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.153576 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.153709 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.153827 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.153944 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154069 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154187 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154303 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154420 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154606 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154729 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154855 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.154964 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.155065 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.155231 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.155366 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.155516 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.155660 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.155660 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.155936 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.156090 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.156220 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.156357 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.156534 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.156659 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.156790 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.156963 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.157153 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.157331 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.157475 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.157647 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.157806 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.157929 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158040 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158169 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158272 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158387 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158512 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158629 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158746 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158874 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.158993 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.159117 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.159234 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.159349 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.159499 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.159691 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.159872 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.160078 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.160323 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.160508 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.160721 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.160854 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.160964 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.160964 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.161219 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.161336 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.161336 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.161633 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.161759 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.161945 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162080 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162199 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162326 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162487 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162611 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162864 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.162989 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.163116 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.163241 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.163359 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.163598 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.163789 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.163973 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164120 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164241 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164364 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164481 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164597 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164722 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164840 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.164957 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.165073 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.165176 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.165316 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.165481 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.165602 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.165735 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.165904 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.166086 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.166272 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.166470 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.166597 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.166724 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.166842 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.166990 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.167147 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.167282 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.167449 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.167628 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.167833 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.167962 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168111 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168238 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168357 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168460 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168582 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168700 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168825 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.168943 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.169097 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.169312 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.169442 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.169569 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.169695 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.169813 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.169813 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.170077 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.170343 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.170556 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.170724 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.170850 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.170967 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171078 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171220 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171354 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171480 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171609 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171732 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171858 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.171975 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.172187 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.172315 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.172432 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.172432 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.172654 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.172771 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.172901 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173019 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173135 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173251 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173367 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173367 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173732 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173862 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.173987 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174105 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174222 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174348 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174466 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174591 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174710 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174827 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174952 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.174952 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.175304 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.175492 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.175492 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.175825 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.175946 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176099 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176220 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176337 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176463 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176588 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176715 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176833 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.176950 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.177080 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.177261 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.177459 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.177665 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.177837 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.178203 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.178901 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.179698 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.179842 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180049 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180049 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180268 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180421 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180528 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180673 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180824 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.180824 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181017 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181126 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181259 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181377 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181494 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181596 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181697 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181797 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.181918 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182028 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182130 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182255 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182372 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182475 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182587 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182587 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182775 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182887 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.182989 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.183093 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.183268 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.183429 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.183607 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.183816 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184134 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184245 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184347 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184448 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184548 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184670 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184758 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184880 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.184998 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.185117 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.185278 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.185452 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.185642 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.185919 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.186226 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.186431 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.186593 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.186748 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.186924 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.187043 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.187226 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.187356 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.187544 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.187692 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.187877 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188033 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188196 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188324 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188324 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188537 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188639 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188740 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188847 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.188957 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189078 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189247 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189415 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189533 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189636 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189753 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189856 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.189957 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.190057 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.190169 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.190280 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.190533 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.190817 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.190817 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.191153 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.191153 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.191422 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.191574 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.191697 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.191815 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.191980 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.192197 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.192374 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.192498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.192626 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.192626 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.192857 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.192975 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.193100 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.193226 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.193346 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.193528 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.193707 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.193840 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.193969 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.194201 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.194334 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.194499 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.194669 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.194840 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.195040 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.195224 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.195407 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.195599 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.195770 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.195972 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.196227 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.196351 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.196468 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.196584 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.196721 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.196849 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.196968 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.197090 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.197209 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.197324 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.197440 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.197629 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.197768 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.197915 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198070 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198210 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198375 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198509 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198635 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198754 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198871 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.198988 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.199113 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.199230 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.199353 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.199485 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.199636 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.199756 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.199882 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.200021 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.200200 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.200379 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.200652 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.200817 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.200962 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.201134 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.201257 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.201426 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.201570 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.201690 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.201817 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.201937 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202055 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202186 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202308 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202452 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202571 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202699 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202805 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.202981 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.203167 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.203708 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.203874 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.204076 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.204212 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.204431 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.204566 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.204772 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.204894 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.205060 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.205256 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.205453 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.205593 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.205714 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.205841 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.205957 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.206142 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.206327 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.206472 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.206645 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.206645 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.206889 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207008 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207125 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207250 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207377 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207509 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207643 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207782 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.207983 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.208168 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.208316 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.208492 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.208625 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.208748 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.208933 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.209118 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.209317 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.209446 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.209564 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.209683 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.209809 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210000 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210179 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210326 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210446 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210572 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210753 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210875 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.210993 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.211120 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.211292 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.211513 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.211656 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.211853 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.212043 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.212167 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.212303 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.212425 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.212544 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.212713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.212898 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213091 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213226 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213359 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213488 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213488 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213712 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213830 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.213955 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.214083 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.214200 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.214317 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.214450 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.214703 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.214899 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.214899 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.215246 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.215246 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.215246 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.215246 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.215867 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.215987 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.216185 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.216339 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.216459 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.216590 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.216719 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.216838 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.216956 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.217182 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.217305 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.217437 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.217583 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.217759 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.217939 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.218115 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.218304 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.218468 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.218651 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.218780 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.218899 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.219016 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.219133 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.219260 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.219260 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.219583 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.219762 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.219900 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220050 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220181 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220181 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220404 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220540 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220540 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220862 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.220983 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.221101 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.221218 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.221369 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.221529 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.221673 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.221797 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.221926 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222045 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222161 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222288 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222406 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222524 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222626 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222745 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222863 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.222988 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.223106 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.223223 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.223346 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.223473 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.223604 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.223790 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.223983 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.224204 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.224324 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.224449 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.224576 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.224818 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.224980 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.224980 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.225320 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.225501 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.225697 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.225855 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.225975 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.225975 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.226207 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.226351 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.226510 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.226632 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.226789 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.226949 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.227126 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.227262 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.227262 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.227516 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.227639 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.227756 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.227873 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228014 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228137 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228254 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228393 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228544 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228694 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228863 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.228994 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229113 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229113 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229345 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229470 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229588 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229588 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229810 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.229948 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.230135 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.230297 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.230434 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.230559 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.230676 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.230676 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.231000 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.231000 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.231366 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.231550 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.231726 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.231915 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.232168 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.232168 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.232427 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.232545 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.232829 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.232948 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233050 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233183 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233301 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233425 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233550 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233550 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233770 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233895 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.233895 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234115 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234231 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234355 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234481 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234481 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234713 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234842 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.234842 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.235157 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.235284 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.235284 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.235540 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.235663 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.235788 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.235906 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236053 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236181 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236417 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236582 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.236958 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.237100 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.237283 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.237463 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.237766 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.237905 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238025 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238143 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238260 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238379 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238526 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238686 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238827 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.238994 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239118 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239244 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239244 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239496 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239622 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239740 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239848 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.239982 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.240160 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.240278 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.240407 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.240526 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.240667 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.240798 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.240918 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.241078 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.241198 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.241323 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.241323 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.241563 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.241563 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.241882 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.242067 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.242256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.242433 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.242557 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.242676 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.242794 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.242917 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.243033 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.243221 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.243385 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.243552 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.243675 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.243793 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.243912 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244060 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244188 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244306 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244433 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244433 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244654 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244781 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.244901 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245042 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245286 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245481 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245620 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245746 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245871 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245990 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.245990 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.246227 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.246227 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.246459 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.246575 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.246751 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.246751 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.246985 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.247112 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.247341 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.247464 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.247603 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.247732 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.247732 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.248227 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.248438 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.248565 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.248721 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.248866 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249013 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249194 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249356 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249484 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249604 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249721 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249848 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.249967 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.250088 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.250240 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.250416 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.250611 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.250808 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.251000 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.251296 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.251492 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.251627 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.251757 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.251934 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.252088 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.252331 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.252471 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.252578 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.252709 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.252837 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.252837 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.253060 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.253060 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.253384 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.253551 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.253672 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.253790 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.253907 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.254023 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.254193 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.254374 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.254558 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.254720 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.254842 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.254959 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255086 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255228 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255460 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255597 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255715 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255831 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255956 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.255956 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.256318 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.256440 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.256557 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.256706 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.256909 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257050 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257177 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257296 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257412 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257540 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257821 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.257980 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.258094 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.258211 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.258338 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.258472 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.258645 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.258828 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.259007 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.259197 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.259364 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.259510 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.259637 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.259756 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.259872 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.260012 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.260146 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.260265 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.260383 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.260500 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.260639 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.260817 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261002 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261258 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261398 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261517 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261654 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261792 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261912 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.261912 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.262266 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.262441 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.262595 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.262723 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.262723 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.262947 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.262947 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.263176 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.263301 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.263410 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.263546 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.263665 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.263783 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.263929 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.264191 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.264391 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.264566 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.264704 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.264834 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.264980 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265170 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265296 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265474 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265773 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265773 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265773 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265773 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265773 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265773 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.265773 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.266718 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.267839 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.268736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.269747 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.269747 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.269747 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.269747 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.269747 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.270306 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.270306 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.270665 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.270848 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.271138 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.271473 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.271787 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.275803 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.276764 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.277695 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.277695 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.277695 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.278030 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.278291 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:35:37.278538 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:35:37.413413 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO dbcounter [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Registered counter for database nova_api Aug 30 14:35:37.435123 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_db.sqlalchemy.engines [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.442787 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writer thread running {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:37.446556 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO dbcounter [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Registered counter for database nova_api Aug 30 14:35:37.469673 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.477119 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writer thread running {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:37.502448 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.context [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a8b5f18-5bf8-494b-9cd5-57a6421af099(cell1) {{(pid=112142) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:35:37.506770 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:35:37.507247 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:35:37.509008 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:35:37.509662 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:35:37.510100 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:35:37.512358 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:35:37.514544 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO dbcounter [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Registered counter for database nova_cell0 Aug 30 14:35:37.521056 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO dbcounter [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Registered counter for database nova_cell1 Aug 30 14:35:37.529747 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_db.sqlalchemy.engines [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.537888 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writer thread running {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:37.539056 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_db.sqlalchemy.engines [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.539188 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.context [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a8b5f18-5bf8-494b-9cd5-57a6421af099(cell1) {{(pid=112141) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:35:37.543451 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_concurrency.lockutils [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:35:37.544178 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_concurrency.lockutils [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:35:37.546342 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_concurrency.lockutils [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:35:37.547209 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_concurrency.lockutils [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:35:37.547646 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_concurrency.lockutils [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:35:37.549736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_concurrency.lockutils [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:35:37.551836 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO dbcounter [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Registered counter for database nova_cell0 Aug 30 14:35:37.556163 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO dbcounter [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Registered counter for database nova_cell1 Aug 30 14:35:37.563800 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.570711 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writer thread running {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:37.571439 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.705060 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writer thread running {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:37.716123 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO dbcounter [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Registered counter for database nova_cell0 Aug 30 14:35:37.717335 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writer thread running {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:37.725750 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_db.sqlalchemy.engines [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.726475 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO dbcounter [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Registered counter for database nova_cell0 Aug 30 14:35:37.732274 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writer thread running {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:37.735780 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG oslo_db.sqlalchemy.engines [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:35:37.741099 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writer thread running {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:35:38.085180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: WARNING keystonemiddleware.auth_token [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:35:38.089155 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: WARNING keystonemiddleware.auth_token [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:35:38.093245 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: WARNING keystonemiddleware.auth_token [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:35:38.097304 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: WARNING keystonemiddleware.auth_token [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:35:38.453936 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: WARNING keystonemiddleware.auth_token [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:35:38.460541 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: WARNING keystonemiddleware.auth_token [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:35:38.463808 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: WARNING keystonemiddleware.auth_token [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:35:38.466532 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563666e1f9c0 pid: 112142 (default app) Aug 30 14:35:38.469152 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:38.470502 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002079 Aug 30 14:35:38.471012 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Tue Aug 30 14:35:38 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:38.471210 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: WARNING keystonemiddleware.auth_token [None req-0fd3da00-f7da-4f83-85fb-6f1a549d6881 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:35:38.478353 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563666e1f9c0 pid: 112141 (default app) Aug 30 14:37:02.727911 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:02.729566 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 Aug 30 14:37:02.729976 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:02.747093 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writing DB stats nova_api:SELECT=3 {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.748704 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writing DB stats nova_cell0:SELECT=3 {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.749693 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writing DB stats nova_cell1:SELECT=3 {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:02.750561 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:03.699096 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-6b2bd425-cf94-488b-ba43-3042245e3b18 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:03.735040 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-6b2bd425-cf94-488b-ba43-3042245e3b18 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.997737 Aug 30 14:37:03.736044 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 14:37:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:37:06.219027 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:06.220046 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-71ca149d-5562-4027-8058-b00e83fa6ce5 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 30 14:37:06.220650 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:06.885044 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-78e5f72d-a7bf-4f72-bf32-098f1403bb12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:06.943599 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-78e5f72d-a7bf-4f72-bf32-098f1403bb12 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.716279 Aug 30 14:37:06.948070 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:37:07.170568 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-9f424dda-c10f-4cba-9321-fa24527e7c70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:07.177279 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_api:SELECT=3 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.178127 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_cell1:SELECT=3 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.179813 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_cell0:SELECT=3 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.179813 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:07.252986 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-9f424dda-c10f-4cba-9321-fa24527e7c70 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294540 Aug 30 14:37:07.254028 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 14:37:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:09.878057 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-78e5f72d-a7bf-4f72-bf32-098f1403bb12 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:09.879874 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-78e5f72d-a7bf-4f72-bf32-098f1403bb12 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002279 Aug 30 14:37:09.880555 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:10.997941 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-f2ac61c9-9036-4283-a740-72734dd35186 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M"}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:11.059550 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-f2ac61c9-9036-4283-a740-72734dd35186 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.171216 Aug 30 14:37:11.060317 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:11.072936 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-36bb2649-d359-4973-afeb-825e981fe45e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:11.119275 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-36bb2649-d359-4973-afeb-825e981fe45e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049865 Aug 30 14:37:11.132034 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 14:37:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:37:13.673468 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-f2ac61c9-9036-4283-a740-72734dd35186 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:13.674369 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-f2ac61c9-9036-4283-a740-72734dd35186 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 30 14:37:13.674768 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:14.216588 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-89c0750c-7a0a-412a-ba2b-dd16830044df admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:14.239682 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-89c0750c-7a0a-412a-ba2b-dd16830044df admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558228 Aug 30 14:37:14.244037 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:14.258603 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-4eec1e30-18c4-4ccb-86b0-4b1639c15a10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:14.288286 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-4eec1e30-18c4-4ccb-86b0-4b1639c15a10 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035846 Aug 30 14:37:14.289171 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 14:37:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:16.747574 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-89c0750c-7a0a-412a-ba2b-dd16830044df admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:16.748741 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-89c0750c-7a0a-412a-ba2b-dd16830044df admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Aug 30 14:37:16.749146 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:17.353599 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-74190e9f-a4c1-4b2b-a2cb-585c7f85c214 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:17.383253 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-74190e9f-a4c1-4b2b-a2cb-585c7f85c214 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.627521 Aug 30 14:37:17.383858 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:37:17.400378 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-305f689b-f3a1-4f43-8e33-8f8bde4cf751 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:17.439649 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-305f689b-f3a1-4f43-8e33-8f8bde4cf751 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045507 Aug 30 14:37:17.452124 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 14:37:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:20.032838 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-74190e9f-a4c1-4b2b-a2cb-585c7f85c214 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:20.033768 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-74190e9f-a4c1-4b2b-a2cb-585c7f85c214 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Aug 30 14:37:20.035645 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:20.662534 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-ac995b4a-2ae9-40ff-a430-3a02a9669e3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "ram": 4096}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:20.684816 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-ac995b4a-2ae9-40ff-a430-3a02a9669e3c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.643327 Aug 30 14:37:20.688052 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:20.708345 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-6b1a7c5d-9058-4708-a00b-4a8fe97196bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:20.748011 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-6b1a7c5d-9058-4708-a00b-4a8fe97196bd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046518 Aug 30 14:37:20.756159 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Tue Aug 30 14:37:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:23.286862 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-ac995b4a-2ae9-40ff-a430-3a02a9669e3c admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:23.288321 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-ac995b4a-2ae9-40ff-a430-3a02a9669e3c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Aug 30 14:37:23.288923 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:23.794876 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-ddae0b1a-c50c-4e4d-ae58-90eb0379dc0d admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:23.832834 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-ddae0b1a-c50c-4e4d-ae58-90eb0379dc0d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.535903 Aug 30 14:37:23.833298 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 14:37:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:37:26.253932 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-ac995b4a-2ae9-40ff-a430-3a02a9669e3c admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:26.254890 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-ac995b4a-2ae9-40ff-a430-3a02a9669e3c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 30 14:37:26.255317 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:37:26.728297 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-fe5e1424-8117-42bc-a04f-3f7b040541de admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "name": "m1.tiny", "vcpus": 1, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:26.750944 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-fe5e1424-8117-42bc-a04f-3f7b040541de admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.488250 Aug 30 14:37:26.751753 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:26.763649 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-a5319eaf-031b-4f2b-b1b4-9c4896125c11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:26.790683 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-a5319eaf-031b-4f2b-b1b4-9c4896125c11 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030730 Aug 30 14:37:26.791534 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 14:37:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:29.193484 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-fe5e1424-8117-42bc-a04f-3f7b040541de admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:29.194498 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-fe5e1424-8117-42bc-a04f-3f7b040541de admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 30 14:37:29.194903 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:29.655428 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-b003b649-85b8-478b-bb04-4f1136a0ee9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "swap": 0, "vcpus": 1}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:29.677883 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-b003b649-85b8-478b-bb04-4f1136a0ee9d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474792 Aug 30 14:37:29.678576 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:29.693068 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-62bd8b8c-c5dc-4a58-8584-ea3d918646ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:29.721003 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-62bd8b8c-c5dc-4a58-8584-ea3d918646ea admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031978 Aug 30 14:37:29.721820 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 14:37:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:32.079693 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-b003b649-85b8-478b-bb04-4f1136a0ee9d admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:32.080700 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-b003b649-85b8-478b-bb04-4f1136a0ee9d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Aug 30 14:37:32.081383 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:32.689356 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-f36fa5c3-ea1f-448a-822a-2f889a0f902e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:32.712027 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-f36fa5c3-ea1f-448a-822a-2f889a0f902e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.624253 Aug 30 14:37:32.712723 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:37:32.726627 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-a5f0c7a7-d3f3-4502-bbd7-b5460dbdb4af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:32.752315 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-a5f0c7a7-d3f3-4502-bbd7-b5460dbdb4af admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029413 Aug 30 14:37:32.753217 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 14:37:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:37:35.168993 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-f36fa5c3-ea1f-448a-822a-2f889a0f902e admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:35.169923 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-f36fa5c3-ea1f-448a-822a-2f889a0f902e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 30 14:37:35.170578 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:35.662536 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-eb1420df-5598-42bb-9884-4ffaf0ebd06c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:35.669120 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:35.687886 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-eb1420df-5598-42bb-9884-4ffaf0ebd06c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.510698 Aug 30 14:37:35.688752 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:35.702827 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-14442a71-7420-4e63-bc49-cbbeba7e8eae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:35.733405 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-14442a71-7420-4e63-bc49-cbbeba7e8eae admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035852 Aug 30 14:37:35.734271 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 14:37:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:38.163853 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-eb1420df-5598-42bb-9884-4ffaf0ebd06c admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:38.164905 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-eb1420df-5598-42bb-9884-4ffaf0ebd06c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 30 14:37:38.165210 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:37:38.707112 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-89f396e4-d0de-4a01-91a1-4d80df7aac43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:38.713309 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:38.729922 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-89f396e4-d0de-4a01-91a1-4d80df7aac43 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.557222 Aug 30 14:37:38.730837 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Tue Aug 30 14:37:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:37:38.744232 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-2ae9d7c5-ad3e-42bd-9c45-a4d4fcd4b292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:37:38.773983 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-2ae9d7c5-ad3e-42bd-9c45-a4d4fcd4b292 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033813 Aug 30 14:37:38.774809 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Tue Aug 30 14:37:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:56.849700 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-89f396e4-d0de-4a01-91a1-4d80df7aac43 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:56.850716 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-89f396e4-d0de-4a01-91a1-4d80df7aac43 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 30 14:37:56.851088 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:37:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:56.862736 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:57.263792 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-87d293ca-686d-4fbf-9841-eeae51c1ea73 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:57.285311 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-87d293ca-686d-4fbf-9841-eeae51c1ea73 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426943 Aug 30 14:37:57.285782 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 14:37:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:37:58.408155 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-89f396e4-d0de-4a01-91a1-4d80df7aac43 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:58.409218 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-89f396e4-d0de-4a01-91a1-4d80df7aac43 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 30 14:37:58.409598 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:58.974977 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-7ea13302-4c1f-494a-b4c8-73c6b39d3089 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:58.980725 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.wsgi [None req-7ea13302-4c1f-494a-b4c8-73c6b39d3089 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-7ea13302-4c1f-494a-b4c8-73c6b39d3089 admin admin] Request method failure captured: Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Accept: application/json Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Accept-Encoding: gzip, deflate Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Connection: keep-alive Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Content-Length: 0 Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Host: 10.222.0.25 Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Openstack-Api-Version: compute 2.90 Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Openstack-System-Scope: None Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: User-Agent: python-novaclient Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Auth-Token: gAAAAABjDiDGkpQQJWC-4zo55RMP3F-vHU88Phxww-zCB0shRj-KSP4_ovv1K8n06UMLWb4q_zfvawugNf-RqgcexldFmOsZ-B4ZdhbP7G_4ZcTjpPkUofesT9UMb6GBoRwZSqdZYNfqXtmguJEwL-9oyEwKOmQ2UrAE8s2FHDTjU0xGDzSnbSs Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Domain-Id: None Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Domain-Name: None Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Identity-Status: Confirmed Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Is-Admin-Project: True Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Domain-Id: default Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Domain-Name: Default Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Name: admin Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Role: admin,reader,member Aug 30 14:37:58.983940 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Roles: admin,reader,member Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9ccb338f4e0425cad7e44cb87838ce1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant: admin Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant-Name: admin Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User: admin Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Domain-Id: default Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Domain-Name: Default Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Id: 5f1827dde46f4915bfe3277a281b43bd Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Name: admin Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: method: > Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: exception: Flavor 42 could not be found. Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: action_args: {'id': '42'} Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:37:58.985498 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:37:58.986410 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:37:58.988042 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-7ea13302-4c1f-494a-b4c8-73c6b39d3089 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:37:58.989571 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-7ea13302-4c1f-494a-b4c8-73c6b39d3089 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.439903 Aug 30 14:37:58.989571 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 14:37:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:37:58.996636 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-d0fc7c12-f900-4c3b-b96f-0814c65abf7f admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:59.020153 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-d0fc7c12-f900-4c3b-b96f-0814c65abf7f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027214 Aug 30 14:37:59.020703 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 14:37:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:37:59.030959 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-9a746aae-3060-4387-a43d-aa8b1f7b7086 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:59.054017 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-9a746aae-3060-4387-a43d-aa8b1f7b7086 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026687 Aug 30 14:37:59.054568 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 14:37:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:37:59.064805 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-792d2a4c-14a1-44f0-87d3-d4aadf12c73c admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:59.070870 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.wsgi [None req-792d2a4c-14a1-44f0-87d3-d4aadf12c73c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-792d2a4c-14a1-44f0-87d3-d4aadf12c73c admin admin] Request method failure captured: Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Accept: application/json Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Accept-Encoding: gzip, deflate Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Connection: keep-alive Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Content-Length: 0 Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Host: 10.222.0.25 Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Openstack-Api-Version: compute 2.90 Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Openstack-System-Scope: None Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: User-Agent: python-novaclient Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Auth-Token: gAAAAABjDiDGkpQQJWC-4zo55RMP3F-vHU88Phxww-zCB0shRj-KSP4_ovv1K8n06UMLWb4q_zfvawugNf-RqgcexldFmOsZ-B4ZdhbP7G_4ZcTjpPkUofesT9UMb6GBoRwZSqdZYNfqXtmguJEwL-9oyEwKOmQ2UrAE8s2FHDTjU0xGDzSnbSs Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Domain-Id: None Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Domain-Name: None Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Identity-Status: Confirmed Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Is-Admin-Project: True Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Domain-Id: default Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Domain-Name: Default Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Name: admin Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Role: admin,reader,member Aug 30 14:37:59.074795 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Roles: admin,reader,member Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9ccb338f4e0425cad7e44cb87838ce1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant: admin Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant-Name: admin Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User: admin Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Domain-Id: default Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Domain-Name: Default Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Id: 5f1827dde46f4915bfe3277a281b43bd Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Name: admin Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: method: > Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: exception: Flavor 42 could not be found. Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: action_args: {'id': '42'} Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:37:59.076395 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:37:59.077256 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:37:59.078362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-792d2a4c-14a1-44f0-87d3-d4aadf12c73c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:37:59.079562 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-792d2a4c-14a1-44f0-87d3-d4aadf12c73c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015112 Aug 30 14:37:59.079562 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 14:37:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:00.046516 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-9a746aae-3060-4387-a43d-aa8b1f7b7086 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:00.047531 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-9a746aae-3060-4387-a43d-aa8b1f7b7086 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 30 14:38:00.047931 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:38:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:38:00.624362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-fc4765ed-647d-48eb-b4e4-445b69d1eff1 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:00.630212 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.wsgi [None req-fc4765ed-647d-48eb-b4e4-445b69d1eff1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-fc4765ed-647d-48eb-b4e4-445b69d1eff1 admin admin] Request method failure captured: Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Accept: application/json Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Accept-Encoding: gzip, deflate Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Connection: keep-alive Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Content-Length: 0 Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Host: 10.222.0.25 Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Openstack-Api-Version: compute 2.90 Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Openstack-System-Scope: None Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: User-Agent: python-novaclient Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Auth-Token: gAAAAABjDiDHqEGx-UPhwqu2ep4FlFGEYfZ_E0Jl6neGhGIEj7L8WeKMxNABj14sr7-dr8fkpMzPnciuytvh1IF989vuaKlRKMK5CwL9ObbWoj03f2H3wl6hUJI-S6cC8FDXeNQq5lx0rsQTTXtOMMZlry-VsN-m_XcrgEcP17irVYvdpbdS0ng Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Domain-Id: None Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Domain-Name: None Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Identity-Status: Confirmed Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Is-Admin-Project: True Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Domain-Id: default Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Domain-Name: Default Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Name: admin Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Role: admin,reader,member Aug 30 14:38:00.631764 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Roles: admin,reader,member Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9ccb338f4e0425cad7e44cb87838ce1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant: admin Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant-Name: admin Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User: admin Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Domain-Id: default Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Domain-Name: Default Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Id: 5f1827dde46f4915bfe3277a281b43bd Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Name: admin Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: method: > Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: exception: Flavor 84 could not be found. Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: action_args: {'id': '84'} Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:38:00.633180 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:00.633966 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.635537 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-fc4765ed-647d-48eb-b4e4-445b69d1eff1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:38:00.636785 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-fc4765ed-647d-48eb-b4e4-445b69d1eff1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.445537 Aug 30 14:38:00.636785 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 14:38:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:00.643830 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-7ffc5785-305a-4042-9301-541d6a33342b admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:00.659516 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-7ffc5785-305a-4042-9301-541d6a33342b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019601 Aug 30 14:38:00.660120 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 14:38:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:38:00.670187 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-46ea0cdc-18b8-40b1-b6c9-eb1b89c3ba68 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:00.687297 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-46ea0cdc-18b8-40b1-b6c9-eb1b89c3ba68 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020843 Aug 30 14:38:00.687855 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 14:38:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:38:00.697867 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-46ae2578-fce7-4ac3-920a-59ec2947285b admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:00.704148 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.wsgi [None req-46ae2578-fce7-4ac3-920a-59ec2947285b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-46ae2578-fce7-4ac3-920a-59ec2947285b admin admin] Request method failure captured: Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Accept: application/json Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Accept-Encoding: gzip, deflate Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Connection: keep-alive Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Content-Length: 0 Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Host: 10.222.0.25 Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Openstack-Api-Version: compute 2.90 Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Openstack-System-Scope: None Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: User-Agent: python-novaclient Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Auth-Token: gAAAAABjDiDHqEGx-UPhwqu2ep4FlFGEYfZ_E0Jl6neGhGIEj7L8WeKMxNABj14sr7-dr8fkpMzPnciuytvh1IF989vuaKlRKMK5CwL9ObbWoj03f2H3wl6hUJI-S6cC8FDXeNQq5lx0rsQTTXtOMMZlry-VsN-m_XcrgEcP17irVYvdpbdS0ng Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Domain-Id: None Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Domain-Name: None Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Identity-Status: Confirmed Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Is-Admin-Project: True Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Domain-Id: default Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Domain-Name: Default Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Name: admin Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Role: admin,reader,member Aug 30 14:38:00.705666 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Roles: admin,reader,member Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9ccb338f4e0425cad7e44cb87838ce1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant: admin Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant-Name: admin Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User: admin Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Domain-Id: default Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Domain-Name: Default Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Id: 5f1827dde46f4915bfe3277a281b43bd Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Name: admin Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: method: > Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: exception: Flavor 84 could not be found. Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: action_args: {'id': '84'} Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:38:00.707274 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:00.708162 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:00.709300 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-46ae2578-fce7-4ac3-920a-59ec2947285b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:38:00.710296 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-46ae2578-fce7-4ac3-920a-59ec2947285b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012896 Aug 30 14:38:00.710296 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Tue Aug 30 14:38:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:01.694827 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-46ea0cdc-18b8-40b1-b6c9-eb1b89c3ba68 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:01.695822 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-46ea0cdc-18b8-40b1-b6c9-eb1b89c3ba68 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 30 14:38:01.696247 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:38:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:38:02.239341 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-62a0d97a-d02a-4000-a4e6-40e3c3cc6b00 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:02.245881 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.wsgi [None req-62a0d97a-d02a-4000-a4e6-40e3c3cc6b00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-62a0d97a-d02a-4000-a4e6-40e3c3cc6b00 admin admin] Request method failure captured: Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Accept: application/json Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Accept-Encoding: gzip, deflate Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Connection: keep-alive Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Content-Length: 0 Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Host: 10.222.0.25 Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Openstack-Api-Version: compute 2.90 Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Openstack-System-Scope: None Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: User-Agent: python-novaclient Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Auth-Token: gAAAAABjDiDJA95gJgZwqcGG7ZnMZ7-pMfPuelVJnG0aEGSxlorkzFUsREvu-SrYICdY4CiBzrd-CugXn2TaksKCejJU_gIn4xLunmsIUM8sBHhIRUr1vWWd22cgTdmJNsnmQkQs_mk2BPnVDNyISc6lqoSSrZRI1_La_CO0znm7PbFjbXmBiAU Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Domain-Id: None Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Domain-Name: None Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Identity-Status: Confirmed Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Is-Admin-Project: True Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Domain-Id: default Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Domain-Name: Default Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Project-Name: admin Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Role: admin,reader,member Aug 30 14:38:02.247389 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Roles: admin,reader,member Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9ccb338f4e0425cad7e44cb87838ce1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant: admin Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-Tenant-Name: admin Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User: admin Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Domain-Id: default Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Domain-Name: Default Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Id: 5f1827dde46f4915bfe3277a281b43bd Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: X-User-Name: admin Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: method: > Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: exception: Flavor 451 could not be found. Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: action_args: {'id': '451'} Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:38:02.248826 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:02.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.250712 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-62a0d97a-d02a-4000-a4e6-40e3c3cc6b00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:38:02.251864 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-62a0d97a-d02a-4000-a4e6-40e3c3cc6b00 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416709 Aug 30 14:38:02.251864 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 14:38:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:02.258652 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-69a82a78-5f54-4e05-b570-d3aee45f47bf admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:02.274476 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-69a82a78-5f54-4e05-b570-d3aee45f47bf admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019369 Aug 30 14:38:02.275038 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 14:38:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:38:02.285614 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:02.301358 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019268 Aug 30 14:38:02.301922 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Tue Aug 30 14:38:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:38:02.311836 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-78c4ec42-24da-4906-89b0-7ffc1d804721 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:02.317563 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.wsgi [None req-78c4ec42-24da-4906-89b0-7ffc1d804721 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-78c4ec42-24da-4906-89b0-7ffc1d804721 admin admin] Request method failure captured: Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Accept: application/json Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Accept-Encoding: gzip, deflate Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Connection: keep-alive Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Content-Length: 0 Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Host: 10.222.0.25 Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Openstack-Api-Version: compute 2.90 Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Openstack-System-Scope: None Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: User-Agent: python-novaclient Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Auth-Token: gAAAAABjDiDJA95gJgZwqcGG7ZnMZ7-pMfPuelVJnG0aEGSxlorkzFUsREvu-SrYICdY4CiBzrd-CugXn2TaksKCejJU_gIn4xLunmsIUM8sBHhIRUr1vWWd22cgTdmJNsnmQkQs_mk2BPnVDNyISc6lqoSSrZRI1_La_CO0znm7PbFjbXmBiAU Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Domain-Id: None Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Domain-Name: None Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Identity-Status: Confirmed Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Is-Admin-Project: True Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Domain-Id: default Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Domain-Name: Default Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Project-Name: admin Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Role: admin,reader,member Aug 30 14:38:02.319103 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Roles: admin,reader,member Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f9ccb338f4e0425cad7e44cb87838ce1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f9ccb338f4e0425cad7e44cb87838ce1", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant: admin Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant-Id: f9ccb338f4e0425cad7e44cb87838ce1 Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-Tenant-Name: admin Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User: admin Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Domain-Id: default Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Domain-Name: Default Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Id: 5f1827dde46f4915bfe3277a281b43bd Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: X-User-Name: admin Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: method: > Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: exception: Flavor 451 could not be found. Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: action_args: {'id': '451'} Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:38:02.320713 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:02.321610 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: ERROR nova.api.openstack.wsgi Aug 30 14:38:02.322831 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-78c4ec42-24da-4906-89b0-7ffc1d804721 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:38:02.324293 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-78c4ec42-24da-4906-89b0-7ffc1d804721 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012337 Aug 30 14:38:02.324293 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 14:38:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:38:03.307933 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:03.308978 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 30 14:38:03.309374 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:38:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:38:03.861362 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-db37fff5-d699-4317-a400-a311b4b02fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:38:03.887099 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-db37fff5-d699-4317-a400-a311b4b02fb7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.439611 Aug 30 14:38:03.887672 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 14:38:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:04.875284 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:04.876358 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 30 14:38:04.876794 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:38:05.434214 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-3d9f1977-3566-4aaf-9fa5-bb3b059cc07f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:38:05.455021 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-3d9f1977-3566-4aaf-9fa5-bb3b059cc07f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.435781 Aug 30 14:38:05.455569 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 14:38:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:06.440286 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:06.441302 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 30 14:38:06.441698 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:38:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:38:07.047710 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-5b3f0615-f97c-4da1-abe5-b14a55b7b554 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:38:07.069998 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-5b3f0615-f97c-4da1-abe5-b14a55b7b554 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.483079 Aug 30 14:38:07.070539 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 14:38:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:08.056824 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:08.057962 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Aug 30 14:38:08.058361 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:38:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:38:08.607338 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-3f24a1f6-442d-47ce-8f75-6a09e56513f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:38:08.628696 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-3f24a1f6-442d-47ce-8f75-6a09e56513f9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.434303 Aug 30 14:38:08.629276 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Tue Aug 30 14:38:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:38:09.621667 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:09.623072 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 14:38:09.623072 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:38:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:38:10.228459 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-0a95db90-f946-46d1-aed2-4979fc8dbdbe admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:38:10.250609 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-0a95db90-f946-46d1-aed2-4979fc8dbdbe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.478385 Aug 30 14:38:10.251124 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Tue Aug 30 14:38:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:39:04.502453 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:39:04.503541 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-c5645bd2-357d-4e81-9b5c-6b6a14cbc581 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 30 14:39:04.503928 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Tue Aug 30 14:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:39:04.515034 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:04.928089 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-7a80c5c3-6189-4aaf-a0e4-37729836fe80 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:39:04.949085 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-7a80c5c3-6189-4aaf-a0e4-37729836fe80 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.438544 Aug 30 14:39:04.949710 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Tue Aug 30 14:39:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:39:04.972273 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG dbcounter [-] [112141] Writing DB stats nova_api:SELECT=14 {{(pid=112141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:39:04.976332 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-e4483070-64c9-4462-b2d1-fea284d78156 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:39:04.984628 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-e4483070-64c9-4462-b2d1-fea284d78156 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014239 Aug 30 14:39:04.985156 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Aug 30 14:39:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:39:04.998004 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-11495cd6-43b8-407e-aba9-0c63e3d74268 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:39:05.006313 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-11495cd6-43b8-407e-aba9-0c63e3d74268 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011979 Aug 30 14:39:05.006852 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Aug 30 14:39:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:39:05.020219 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:39:05.030095 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014477 Aug 30 14:39:05.030638 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Tue Aug 30 14:39:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:39:05.046029 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-49fc6a94-95c0-4d92-84c5-880cee5126ca admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:39:05.054295 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-49fc6a94-95c0-4d92-84c5-880cee5126ca admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013127 Aug 30 14:39:05.054848 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Tue Aug 30 14:39:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:01.670943 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:01.671988 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 30 14:42:01.672428 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:01.817221 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_api:SELECT=6 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:01.999750 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:02.003205 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:02.003774 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:02.004213 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:02.004926 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:02.005360 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:02.005772 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:02.040324 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-17e9132a-4573-488c-bd34-56e33485d726 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.225639 Aug 30 14:42:02.040904 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 14:42:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:42:02.887429 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:02.888473 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001649 Aug 30 14:42:02.888907 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:03.088413 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:03.091891 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:03.092411 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:03.092830 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:03.093563 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:03.094018 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:03.094429 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:03.121814 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-e82d6cb4-ad62-4183-a88c-9013830ecfcc admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.092500 Aug 30 14:42:03.122407 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 14:42:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:42:14.379202 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:14.380255 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 30 14:42:14.380692 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:14.526496 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_cell0:SELECT=4 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:14.527228 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_cell1:SELECT=4 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:14.527812 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG dbcounter [-] [112142] Writing DB stats nova_api:SELECT=8 {{(pid=112142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:14.578815 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:14.582150 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:14.582633 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:14.583053 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:14.583896 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:14.584679 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:14.584789 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:14.610027 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-47791f36-655b-47bf-a7dd-6b48b37788d9 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088124 Aug 30 14:42:14.610587 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 14:42:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:42:15.441697 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: DEBUG nova.api.openstack.wsgi [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] Calling method '>' {{(pid=112141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:15.442719 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: INFO nova.api.openstack.requestlog [None req-0cc514a4-5e96-49cb-93be-620ac6280540 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 30 14:42:15.443895 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: [pid: 112141|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Tue Aug 30 14:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:15.644118 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG nova.api.openstack.wsgi [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] Calling method '>' {{(pid=112142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:15.648752 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:15.649227 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:15.649654 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:15.650360 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:15.650802 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:15.651213 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: DEBUG oslo_concurrency.lockutils [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:15.673637 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: INFO nova.api.openstack.requestlog [None req-7be60a71-6c4f-431c-936a-1ebfe6644671 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086242 Aug 30 14:42:15.674206 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: [pid: 112142|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Tue Aug 30 14:42:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:13.849602 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: Tue Aug 30 14:43:13 2022 - graceful shutdown triggered... Aug 30 14:43:13.850173 dv-cinder-828805-5-iscsi devstack@n-api.service[112141]: Gracefully killing worker 1 (pid: 112141)... Aug 30 14:43:13.849717 dv-cinder-828805-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 14:43:13.851013 dv-cinder-828805-5-iscsi devstack@n-api.service[112142]: Gracefully killing worker 2 (pid: 112142)... Aug 30 14:43:14.850912 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: worker 1 buried after 1 seconds Aug 30 14:43:14.850912 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: worker 2 buried after 1 seconds Aug 30 14:43:14.850912 dv-cinder-828805-5-iscsi devstack@n-api.service[112140]: goodbye to uWSGI. Aug 30 14:43:14.852554 dv-cinder-828805-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 14:43:14.853102 dv-cinder-828805-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 14:43:14.855974 dv-cinder-828805-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 14:43:14.867657 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 14:43:14 2022] *** Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: nodename: dv-cinder-828805-5-iscsi Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: machine: x86_64 Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: clock source: unix Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: pcre jit disabled Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: detected number of CPU cores: 4 Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: current working directory: / Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: detected binary path: /usr/bin/uwsgi-core Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: your processes number limit is 47680 Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: your memory page size is 4096 bytes Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: detected max file descriptor number: 2048 Aug 30 14:43:14.870423 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: lock engine: pthread robust mutexes Aug 30 14:43:14.871442 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: thunder lock: enabled Aug 30 14:43:14.871442 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 14:43:14.871442 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 14:43:14.912022 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: Python main interpreter initialized at 0x55d5e285c9c0 Aug 30 14:43:14.912022 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: python threads support enabled Aug 30 14:43:14.912022 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: your server socket listen backlog is limited to 100 connections Aug 30 14:43:14.912022 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: your mercy for graceful operations on workers is 90 seconds Aug 30 14:43:14.912454 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 14:43:14.912454 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: *** Operational MODE: preforking *** Aug 30 14:43:14.912783 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: *** uWSGI is running in multiple interpreter mode *** Aug 30 14:43:14.912783 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: spawned uWSGI master process (pid: 127156) Aug 30 14:43:14.912994 dv-cinder-828805-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 14:43:14.913589 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: spawned uWSGI worker 1 (pid: 127176, cores: 1) Aug 30 14:43:14.914118 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: spawned uWSGI worker 2 (pid: 127177, cores: 1) Aug 30 14:43:14.914389 dv-cinder-828805-5-iscsi devstack@n-api.service[127156]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 14:43:15.572467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:43:15.573108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:43:16.723606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:43:16.723606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: from cryptography.utils import int_from_bytes Aug 30 14:43:16.724483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:43:16.724483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: from cryptography.utils import int_from_bytes Aug 30 14:43:16.726124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:43:16.726124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: from cryptography.utils import int_from_bytes Aug 30 14:43:16.726607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:43:16.726607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: from cryptography.utils import int_from_bytes Aug 30 14:43:19.149042 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:43:19.149802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:43:19.149802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:43:19.150161 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:43:19.150443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:43:19.150786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.151143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.151427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.151966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.152491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.152837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.153126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.153445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.153773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.154040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.154347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.154676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-5-iscsi {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.154998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.155302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.155611 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.155966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.156259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.156840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.157163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.157666 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.158937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.158937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.159137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.159349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.159659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.159966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.160303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.160608 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.160977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.161237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.161653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-5-iscsi {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.161966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.162274 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.162583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.163005 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.163312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.163621 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.163940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.164286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.164600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.165012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.165254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.165569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.165929 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.166220 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.166473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.166803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.167094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.167396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.167699 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.167944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.168272 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.168591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.168919 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.169261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.169464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.169711 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.170028 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.170351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.170678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.170981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.171283 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.171586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.171885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.172561 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.172561 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.172829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.173147 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.173459 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.173770 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.174078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.174390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.174797 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.175044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.175347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.175683 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.176032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.176322 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.176635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.176951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.177255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.177570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.177858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.178172 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.178501 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.178600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:43:19.179019 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:43:19.179125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.179125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.179280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:43:19.179379 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.179612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.179740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:43:19.179888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:43:19.180049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.180240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.180343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.180543 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.180641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.180845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.180948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.181142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.181242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.181443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.181692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.181787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.182013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.182113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.182323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.182411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.182623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.182723 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.182923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.183022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.183211 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.183313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.183513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.183612 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.183813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.183916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828805-5-iscsi {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.184151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.184259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.184468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.184559 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.184772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.184872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.185074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.185163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.185373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.185473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.185673 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.185773 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.185990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.186087 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.186287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.186497 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.186614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.186810 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.186910 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.187119 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.187211 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.187430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.187520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.188363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.188484 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.188569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.188569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.188731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.188816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.189265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.189364 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.189667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.190040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.190284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.190374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.190583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.190679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.190951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.191051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.191193 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.191279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.191478 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.191652 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828805-5-iscsi {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.191777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.191976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.192098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.192392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.192494 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.192633 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.192715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.192964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.193050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.193280 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.193369 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.193583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.194759 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.194865 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.194939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195123 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.195487 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.195678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.195860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.195943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.196066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.196996 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.197099 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.197174 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.197246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.197335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.197436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.197522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.197605 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.197692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.197783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.197855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.197945 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.198018 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.198099 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.198183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.198265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.198450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.198637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.198775 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.198882 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.199096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.199194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.199384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.199540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.199622 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.199779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.199910 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.200233 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.200414 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.200520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.200761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.200873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.201052 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.201195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.201397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.201553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.201686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.201787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.202022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.202182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.202362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.202518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.202675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.202782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.203014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.203177 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.203373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.204113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.204113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.204301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.204388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.204493 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.204590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.204683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.204769 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.204852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.204954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.205173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.205343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.205439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.205533 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.205716 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.205875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.206058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.206212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.206378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.206531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.206661 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.206774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.207008 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.207162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.207287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.207385 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.207620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.207784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.207880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.207961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.208238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.208382 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.208545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.208635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.208857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.208956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.209169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.209271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.209418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.209504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.209719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.209822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.210029 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.210134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.210341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.210461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.210660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.210768 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.210961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.211056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.211246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.211346 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.211544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.211640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.211861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.211967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.212189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.212295 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.212495 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.212600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.212787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.212920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.213110 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.213226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.213413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.213515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.213718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.213824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.214024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.214126 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.214327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.214439 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.214634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.214734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.214936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.215040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.215244 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.215392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.215546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.215642 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.215846 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.215940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.216190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.216305 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.216496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.216600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.216797 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.216889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.217100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.217201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.217405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.217501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.217708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.217799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.218017 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.218106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.218323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.218423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.218630 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.218727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.219090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.219531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.219633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.219726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.219726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.219897 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.219991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.220111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.220220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.220313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.220535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.220648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.220838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.220939 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.221140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.221231 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.221440 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.221532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.221732 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.221827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.222036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.222136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.222337 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.222439 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.222638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.222745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.222936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.223037 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.223232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.223333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.223532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.223624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.223838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.223928 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.224170 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.224343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.224477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.224642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.224778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:43:19.225020 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.225110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.225332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.225432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.225634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.225765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.225952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.226096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.226399 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.226730 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.226819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.227070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.227187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.227385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.227494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.227690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.227781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.228056 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.228393 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.228827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.228925 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.229147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.229281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.229598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.229692 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.229917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.229998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.230233 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.230325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.230666 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.230771 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.230855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.230927 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.231151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.231232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.231504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.231625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.231882 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.232075 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.232155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.232265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.232422 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.232580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.232754 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.232901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.233138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.233241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.233386 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.233728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.234035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.234133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.234383 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.234534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.234727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.234841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.235397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.235590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.235675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.235755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.235838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.235911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.236334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.236510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.236844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.236988 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237097 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237325 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.237995 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.238309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.238407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.238626 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.238743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.238931 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.239041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.239246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.239441 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.239554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.239769 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.239874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.240205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.240519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.240872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.241076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.241188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.241276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.241348 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.241430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.241709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.241843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.242030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.242152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.242350 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.242466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.242680 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.242789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.242989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.243163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.243302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.243474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.243607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.243796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.243914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.244148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.244295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.244500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.244754 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.244893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.245058 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.245161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.245363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.245490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.245669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.245774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.245981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.246286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.246457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.246590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.246846 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.247006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.247195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.247292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.247507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.247601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.247811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.247925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.248136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.248246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.248448 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.248581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.248769 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.249115 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.249269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.249393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.249485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.249571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.249782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.249938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.250033 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.250482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.250963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251502 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251598 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.251979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.252105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.252178 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.252349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.252524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.252667 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.252760 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.252984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.253075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.253299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.253404 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.253624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.253723 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.253939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.254037 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.254249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.254351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.254562 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.254683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.254907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.255010 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.255193 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.255297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.255495 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.255634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.255804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.255899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.256137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.256295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.256445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.256536 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.256754 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.256852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.257059 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.257151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.257361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.257459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.257665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.257757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.257972 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.258063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.258275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.258377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.258577 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.258727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.258881 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.258973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.259187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.259467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.259566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.259799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.259891 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.260131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.260238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.260449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.260571 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.260758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.260861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.261062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.261164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.261407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.261514 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.261714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.261940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.262035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.262135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.262311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.262412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.262620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.262722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.262922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.263024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.263221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.263313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.263529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.263636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.263829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.263987 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.264219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.264456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.264565 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.264761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.264876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.265068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.265169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.265371 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.265471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.265674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.265991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.266449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.266545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.266638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.266725 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.266809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.266909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.267004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.267172 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.267317 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.267473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.267629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.267793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.267949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.268123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.268318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.268411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.268657 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.268763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.268978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.269077 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.269303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.269403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.269612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.269711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.269925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.270025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.270237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.270336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.270557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.270657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.270870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.270969 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.271169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.271258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.271492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.271592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.271790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.271879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.272122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.272233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.272402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.272520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.272704 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.272898 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.273029 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.273217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.273335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.273538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.273667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.273847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.273974 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.274168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.274286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.274475 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.274600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.274784 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.274985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.275111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.275222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.275360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.275478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.275669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.275796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.275973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.276113 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.276442 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.276564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.276675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.276807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.276921 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.277038 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.277164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.277389 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.277697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.278007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.278322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.278455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.278632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.278808 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.278939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.279197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.279294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.279554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.279645 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.279863 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.280048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.280258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.280392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.280575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.280704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.280904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.281014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.281201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.281336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.281607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.282306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.282459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.282459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.282657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.282752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.282837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.283030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.283134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.283340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.283433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.283649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.283746 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.283955 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.284085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.284287 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.284378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.284609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.284708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.284932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.285063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.285242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.285376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.285545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.285649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.285858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.285978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.286162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.286264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.286479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.286582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.286770 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.286872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.287077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.287168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.287498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.287614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.287781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.287869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.287954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.288108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.288285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.288402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.288589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.288691 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.288911 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.289047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.289220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.289322 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.289520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.289618 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.289824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.289925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.290125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.290217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.290439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.290534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.290744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.290843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.291054 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.291155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.291376 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.291496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.291693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.291969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.292102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.292336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.292444 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.292644 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.292774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.292959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.293072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.293258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.293351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.293571 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.293673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.293881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.293986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.294201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.294318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.294507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.294609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.294811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.294923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.295187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.295319 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.295436 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.295552 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.295744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.295858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.296074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.296765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.296942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.297057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.297236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.297430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.297835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.297936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298032 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298443 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298635 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298719 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.298992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.299085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.299171 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.299378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.299495 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.299721 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.299883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.299988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.300117 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.300313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.300407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.300622 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.300721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.300932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.301030 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.301236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.301326 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.301559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.301677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.301863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.301963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.302166 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.302265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303553 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.303936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.304093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.304523 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.304706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.305018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.305296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.305420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.305631 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.305730 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.305939 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.306241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.306657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.306969 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.307285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.307589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.307896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.308134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.308218 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.308479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.308579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.308836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.308957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.309145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.309246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.309445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.309689 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.309775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.309930 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.310080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.310255 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.310346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.310729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.310827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.310915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.311124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.311226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.311341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.311672 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.311783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.311867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.312079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.312186 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.312391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.312490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.312824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.312939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.313124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.313352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.313457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.313764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.313881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.314438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.314534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.314720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.314811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.314983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.315084 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.315262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.315405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.315591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.315903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.316161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.316293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.316533 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.316877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.317000 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.317172 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.317295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.317514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.317766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.317878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.318151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.318463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.318590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.318805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.318927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.319231 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.319392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.319628 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.319751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320348 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320644 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320752 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.320916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.321163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.321265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.321483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.321596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.321899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.321989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.322072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.322146 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.322402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.322510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.322684 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.322776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.322959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.323061 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.323260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.323409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.323596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.323745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.323936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.324123 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.324288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.324437 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.324585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.324733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.324879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.325026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.325184 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.325344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.325521 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.325686 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.325844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.326006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.326156 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.326610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.326772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.326922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.327071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.327229 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.327385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.327548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.327762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.328334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.328574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.328824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.328983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.329272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.329433 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.329583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.329776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.329945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.330102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.330374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.330532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.330692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.330850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.331006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.331162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.331318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.331479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.331636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.331860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.332155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.332314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.332465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.332620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.332780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.332937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.333095 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.333244 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.333392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.333556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.333714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.333880 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.334030 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.334178 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.334333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.334564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.334717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.334888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.335037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.335192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.335347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.335510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.335510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.335847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.336028 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.336194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.336345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.336835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.336835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.337166 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.337328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.337486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.337486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.337781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.338134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.338447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.338606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.338755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.338919 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.339078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.339235 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.339390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.339390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.339693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.339900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.340090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.340290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.340548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.340704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.340862 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.341021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.341171 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.341338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.341488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.341636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.341805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.341955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.342129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.342375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.342539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.342690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.342853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.343012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.343169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.343169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.343471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.343621 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.343787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.344121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.344439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.344439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.344749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.344921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.345086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.345244 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.345400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.345550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.345715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.345935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.346101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.346251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.346422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.346590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.347049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.347343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.347534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.347534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.347904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.348316 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.348657 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.348864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.349063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.349252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.349456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.349774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.350017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.350220 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.350507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.350868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.351064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.351258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.351460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.351655 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.351840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.352034 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.352262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.352563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.352762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.352960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.353153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.353355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.353542 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.353795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.354014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.354200 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.354394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.354589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.354589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.354969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.355167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.355352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.355539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.355724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.355908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.356153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.356341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.356495 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.356654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.356826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.357272 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.357462 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.357615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.357764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.357971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.358132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.358483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.358860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.359115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.359274 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.359478 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.359645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.359807 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.359958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.360158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.360505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.360747 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361019 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361019 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.361970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.362253 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.362421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.362693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.362961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.363161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.363358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.363543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.363736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.363980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.364274 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.364499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.364694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.364894 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.365098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.365295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.365480 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.365679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.365865 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.366049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.366239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.366424 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.366619 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.366814 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.367001 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.367548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.367738 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.367922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.368157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.368576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.368576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.368925 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.369098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.369358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.369525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.369525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.369819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.370012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.370167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.370316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.370474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.370644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.370853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.371029 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.371287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.371529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.371682 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.371831 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.371979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.372174 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.372358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.372525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.372701 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.372952 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.373109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.373266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.373417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.373417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.373718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.373718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.374061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.374061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.374365 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.374529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.374686 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.374846 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.375007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.375619 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.375790 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.375953 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.376140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.376306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.376459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.376644 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.376807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.376983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.377143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.377634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.377806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.377988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.378251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.378423 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.378762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.378928 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.379087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.379246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.379516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.379676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.379833 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.379983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.380178 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.380340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.380535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.380691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.380849 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.381157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.381424 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.381602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.381758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.381908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.382105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.382269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.382419 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.382578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.382740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.382898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.383159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.383315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.383471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.383630 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.383788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.383937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.384734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.384907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.385073 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.385232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.385388 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.385550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.385698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.385855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.386019 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.386217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.386372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.386372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.386665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.386822 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.386982 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.387131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.387286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.387556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.387957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.388177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.388343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.388528 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.388699 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.389040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.389190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.389349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.389525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.389780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.389935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.390087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.390246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.390405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.390554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.390554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.390905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.391064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.391214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.391384 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.391661 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.391824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.391974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.392158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.392325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.392488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.392637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.392838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.392995 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.393163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.393419 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.393575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.393732 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.393888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.394045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.394195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.394354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.394516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.394664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.394820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.394969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.395127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.395284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.395435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.395583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.395742 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.395891 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.396102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.396258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.396427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.396650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.396813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.396963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.397126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.397276 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.397429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.397701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.398174 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.398342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.398495 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.398644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.398804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.399195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.399361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.399521 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.399671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.399962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.400155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.400307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.400456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.400615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.400765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.400914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.401072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.401237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.401402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.401562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.401847 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.402003 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.402152 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.402340 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.402504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.402664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.402814 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.402962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.403111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.403272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.403452 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.403703 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.403867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.404049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.404218 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.404378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.405180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.405180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.405490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.405649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.405800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.406037 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.406201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.406451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.406611 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.406762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.406911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.407070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.407235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.407386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.407534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.407711 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.407989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.408450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.408450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.411695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.411920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.412216 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.412406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.412571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.412765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.412924 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.413075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.413231 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.413390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.413390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.413711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.413984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.414149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.414300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.414465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.414626 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.414784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.414944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.415103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.415263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.415263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.415556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.415716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.415873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.416054 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.416228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.416381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.416530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.416679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.416827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.416975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.417133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.417289 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.417438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.417595 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.417743 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.417903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.418206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.418671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.418834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.418993 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.419142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.419301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.419459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.419617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.419766 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.419914 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.420146 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.420310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.420478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.420638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.420794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.420951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.421101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.421259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.421483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.422057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.422241 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.422533 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.422693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.423035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.423215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.423380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.423539 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.423690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.423848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.424039 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.424315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.424479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.424630 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.424780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.425006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.425158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.425314 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.425476 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.425634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.425784 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.425941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.426091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.426240 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.426389 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.426545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.426695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.426853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.427002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.427157 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.427306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.427473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.427636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.427786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.427936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.428175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.428453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.428940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.428940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.429252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.429401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.429549 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.429697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.429854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.430033 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.430183 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.430183 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.430474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.430624 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.430780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.430780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.431065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.431065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.431367 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.431576 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.432163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.432346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.432515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.432878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.433133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.433382 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.433608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.433773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.433932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.434090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.434090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.434538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.434709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.434868 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435042 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.435518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.436719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.438037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.440098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.441320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.443085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.444290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.445576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.446728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.448116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.449656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.450967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.452259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.453944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:43:19.455214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:43:19.480678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Registered counter for database nova_api Aug 30 14:43:19.502755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.510881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:19.512821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO dbcounter [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Registered counter for database nova_api Aug 30 14:43:19.534827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.542288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writer thread running {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:19.578245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.context [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a8b5f18-5bf8-494b-9cd5-57a6421af099(cell1) {{(pid=127177) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:43:19.582509 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:19.583030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:19.584629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:19.585375 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:19.585784 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:19.587826 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:19.589900 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Registered counter for database nova_cell0 Aug 30 14:43:19.594459 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Registered counter for database nova_cell1 Aug 30 14:43:19.600770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.context [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a8b5f18-5bf8-494b-9cd5-57a6421af099(cell1) {{(pid=127176) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:43:19.604407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.604961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:19.605204 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.605444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:19.607065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:19.607954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:19.608472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:19.610654 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:19.612267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:19.612768 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO dbcounter [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Registered counter for database nova_cell0 Aug 30 14:43:19.613607 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:19.616872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO dbcounter [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Registered counter for database nova_cell1 Aug 30 14:43:19.625016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.627175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.633668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writer thread running {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:19.636163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writer thread running {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:19.758870 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO dbcounter [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Registered counter for database nova_cell0 Aug 30 14:43:19.766267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_db.sqlalchemy.engines [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.771502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writer thread running {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:19.782660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO dbcounter [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Registered counter for database nova_cell0 Aug 30 14:43:19.790135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:43:19.794902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writer thread running {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:43:20.094038 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:43:20.101467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:43:20.131130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: WARNING keystonemiddleware.auth_token [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:43:20.138514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: WARNING keystonemiddleware.auth_token [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:43:20.459294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:43:20.466619 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: WARNING keystonemiddleware.auth_token [None req-faff172d-ecef-4983-93dc-40e084ab96ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:43:20.473284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5e285c9c0 pid: 127177 (default app) Aug 30 14:43:20.503870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: WARNING keystonemiddleware.auth_token [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:43:20.510342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: WARNING keystonemiddleware.auth_token [None req-dcd2ca41-8cba-4472-a872-6b60032e27b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:43:20.515909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5e285c9c0 pid: 127176 (default app) Aug 30 14:44:01.075905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:01.076937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:01.077830 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:01.078683 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:02.786664 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ad7694e8-7245-43df-85e6-0447c34d2be8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Action: 'create', calling method: .version_select at 0x7fe6a7429e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1203267070"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:04.080195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ad7694e8-7245-43df-85e6-0447c34d2be8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.010730 Aug 30 14:44:04.081349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Tue Aug 30 14:44:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3016 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 14:44:05.073218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-76e6b8ef-a234-4ad3-afb5-a03f8e691dcf tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a748a9d0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:05.131524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:05.133436 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:05.135247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:05.137239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:05.196884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9b8231fa-d2d7-4f82-b7a8-9e13787aac7c tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a72a9ca0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:05.654813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9b8231fa-d2d7-4f82-b7a8-9e13787aac7c tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/409515c7-3b7b-4681-b972-c05d62d71c69" status: 200 len: 351 microversion: 2.1 time: 0.466427 Aug 30 14:44:05.656243 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:44:05 2022] GET /compute/v2.1/os-volumes/409515c7-3b7b-4681-b972-c05d62d71c69 => generated 351 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:06.066961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-76e6b8ef-a234-4ad3-afb5-a03f8e691dcf tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d" status: 200 len: 346 microversion: 2.1 time: 1.960753 Aug 30 14:44:06.067541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:44:04 2022] GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d => generated 346 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:06.094781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b2ae8c48-c6c2-4462-893d-665408f1478a tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Action: 'create', calling method: .version_select at 0x7fe6a72bf3a0>, body: {"snapshot": {"volume_id": "46cd2b7f-36db-4a01-bb51-1f87af0b178d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1527620071"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:06.662500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b2ae8c48-c6c2-4462-893d-665408f1478a tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.573968 Aug 30 14:44:06.663753 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 3/4] 10.222.0.25 () {60 vars in 1162 bytes} [Tue Aug 30 14:44:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:06.690915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-eb002663-69ea-4fe5-bff2-bfb700f449b4 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72dbd30>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:06.908668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-eb002663-69ea-4fe5-bff2-bfb700f449b4 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.235806 Aug 30 14:44:06.909746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 2/5] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:06 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:06.922324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a5cf8e3b-db3e-4f12-bc8a-ed05679a3cae tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72c7430>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:07.012684 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a5cf8e3b-db3e-4f12-bc8a-ed05679a3cae tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.094229 Aug 30 14:44:07.021862 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Aug 30 14:44:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:07.035937 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f14b7830-e15c-4bc9-b0df-074ae92c5ba4 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72dbc10>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:07.165585 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f14b7830-e15c-4bc9-b0df-074ae92c5ba4 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.141659 Aug 30 14:44:07.171194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:07 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:08.186671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0987e0dc-4a6c-4f76-96ba-7923574c74c7 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72bf310>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:08.300923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0987e0dc-4a6c-4f76-96ba-7923574c74c7 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.123805 Aug 30 14:44:08.303060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:08 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:09.336575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ca1df082-5397-4523-8796-97d8b5b2db1e tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72a6550>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:09.428745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ca1df082-5397-4523-8796-97d8b5b2db1e tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.110635 Aug 30 14:44:09.435238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 4/9] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:09 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:10.474636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-789e5a4c-2c71-47c5-b6e8-9b4ee25fae7a tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72a9a60>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:10.581557 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-789e5a4c-2c71-47c5-b6e8-9b4ee25fae7a tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.120214 Aug 30 14:44:10.585270 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:10 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:11.596909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d1c3cceb-d127-4c08-83ae-61b73d8259e8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72a6c10>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:11.702072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d1c3cceb-d127-4c08-83ae-61b73d8259e8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.109170 Aug 30 14:44:11.702991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 5/11] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:11 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:12.720898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c1315892-be92-47f7-86ed-a0ab8dfa96a3 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72c7040>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:12.802327 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c1315892-be92-47f7-86ed-a0ab8dfa96a3 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.087497 Aug 30 14:44:12.805808 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:12 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:13.820564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-823523e4-c022-4dbc-86df-2c4d11cb5cd8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72a6ca0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:13.882677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-823523e4-c022-4dbc-86df-2c4d11cb5cd8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.065969 Aug 30 14:44:13.883435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 6/13] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:13 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:14.904592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0e8d9d5d-271e-4f2d-b124-b63dede318f8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72a6550>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:15.077303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0e8d9d5d-271e-4f2d-b124-b63dede318f8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.181734 Aug 30 14:44:15.094634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:14 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:15.135792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3e30febb-d984-4ec5-8e0b-fb08cb9cbd7a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'create', calling method: .version_select at 0x7fe6a72a9b80>, body: {"keypair": {"name": "tempest-keypair-1836101936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdzv+UgJCPG23XzUJu8I8LZxPWQNp7ixEOTkb4tfjhfA+ZNcvyOqJokJmdccwJq4ASqJt3qCJ+jBIBla33jXYnxtDjrWRT5VHx9H6fsv1f7RoicsmlMph+XXVRWKvxRjg=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:15.322490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3e30febb-d984-4ec5-8e0b-fb08cb9cbd7a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:15.340878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3e30febb-d984-4ec5-8e0b-fb08cb9cbd7a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for user 521cc5ea8fb045bc81e8e3bfa8ba239b and project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:15.495015 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3e30febb-d984-4ec5-8e0b-fb08cb9cbd7a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.697992 Aug 30 14:44:15.495632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 8/15] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 14:44:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 700 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 14:44:16.139698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-923bd6ee-2210-4854-8987-068ced17c142 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a72dbc10>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:16.324099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-923bd6ee-2210-4854-8987-068ced17c142 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.230489 Aug 30 14:44:16.325209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:16 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:17.347580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c3d968ea-3e3e-45da-8339-13962ddaf2bd tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a71d7040>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:17.526470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c3d968ea-3e3e-45da-8339-13962ddaf2bd tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.188329 Aug 30 14:44:17.527772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:17 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:17.766351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-758764509", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:17.958125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] validate_networks() for [('ebed3de8-2f6e-4966-9fa4-3b466a71b3b1', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:44:18.501659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c5032095-32a3-4e60-840c-a4229a4ead7a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'create', calling method: .version_select at 0x7fe6a721f9d0>, body: {"keypair": {"name": "tempest-keypair-964371602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNShY5OuCAiJLygQIURNWlp5eMPFhjE6yxDWnxFqSgszsLOWWf0i+kwhmAUwgvaGxP5husB6V5PNpYQOD3UnFFv9zg/Cg2b70J7GwTwZS51sSCix4kEmxr+P6Xmr5dquqQ=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:18.575392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-c5032095-32a3-4e60-840c-a4229a4ead7a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:18.603704 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-c5032095-32a3-4e60-840c-a4229a4ead7a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for user a1b3f34373414c61b94e2a8d9018cbd5 and project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:18.661334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c5032095-32a3-4e60-840c-a4229a4ead7a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.360724 Aug 30 14:44:18.672192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 10/18] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:44:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:18.674993 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-11792c7a-09cd-4bcf-94b0-1aebcfc044de tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a71e3a60>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:18.733807 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-11792c7a-09cd-4bcf-94b0-1aebcfc044de tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 288 microversion: 2.1 time: 0.069904 Aug 30 14:44:18.741677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 11/19] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:18 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:18.747810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-774f1633-7ad0-47c1-8376-ca0b9c04ac43 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a71e31f0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:19.026037 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-774f1633-7ad0-47c1-8376-ca0b9c04ac43 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 202 len: 0 microversion: 2.1 time: 0.282378 Aug 30 14:44:19.036289 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 12/20] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Aug 30 14:44:18 2022] DELETE /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:44:19.048450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c12b8407-9e6b-4f2a-8fe6-8c20c8bf3feb tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a71d7f70>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:19.147093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c12b8407-9e6b-4f2a-8fe6-8c20c8bf3feb tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.108612 Aug 30 14:44:19.148389 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 13/21] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:19 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:20.168716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-58d971e8-a6d6-4a01-8889-7b053aaed05d tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a71d75e0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:20.185405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:44:20.186045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:44:20.186487 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:44:20.187067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:44:20.187492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:44:20.235984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:20.237136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:20.237136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:20.237718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:20.238203 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:20.238637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:20.279659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-58d971e8-a6d6-4a01-8889-7b053aaed05d tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.118402 Aug 30 14:44:20.282097 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 14/22] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:20 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:20.365475 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for project 52028232fa7e4d808057e3e5512e6135. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:20.418628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for user 3398704b0dbc4af08e94b774a88851a4 and project 52028232fa7e4d808057e3e5512e6135. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:20.463798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:44:20.490685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:44:20.766944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b00062ae-abc7-44cf-bdda-21143857a964 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.107390 Aug 30 14:44:20.768111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 9/23] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:44:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:44:20.799380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b017acb4-ec9e-49a2-bcb2-4b910c40fd40 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:20.801741 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b017acb4-ec9e-49a2-bcb2-4b910c40fd40 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:21.108623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b017acb4-ec9e-49a2-bcb2-4b910c40fd40 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:21.165662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b017acb4-ec9e-49a2-bcb2-4b910c40fd40 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1221 microversion: 2.1 time: 0.381284 Aug 30 14:44:21.168467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 15/24] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:20 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1221 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:21.299437 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6fe56c7a-883f-4487-bf3e-90da8fbdfaa8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a71bd8b0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:21.372519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1126320107", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:21.491601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6fe56c7a-883f-4487-bf3e-90da8fbdfaa8 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.197117 Aug 30 14:44:21.493142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 10/25] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:21 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:21.620329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] validate_networks() for [('ebed3de8-2f6e-4966-9fa4-3b466a71b3b1', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:44:22.371144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1347027624", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "networks": [{"uuid": "299ee204-8f5b-48fc-9655-88704777196e"}]}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:22.595567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] validate_networks() for [('299ee204-8f5b-48fc-9655-88704777196e', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:44:23.303639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:44:23.303639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:44:23.303639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:44:23.303639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:44:23.303639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:44:23.347116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.348096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.348867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.350243 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.354855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.355805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.509898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for project 52028232fa7e4d808057e3e5512e6135. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:23.531320 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for user 3398704b0dbc4af08e94b774a88851a4 and project 52028232fa7e4d808057e3e5512e6135. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:23.588504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:44:23.603267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:44:23.785928 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d823b7ae-f920-4e3e-bf48-97565bf8f628 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.416870 Aug 30 14:44:23.787980 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 16/26] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:44:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:44:23.825000 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5222b864-b109-4302-99e9-b82a75080baa tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a711ae50>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:23.954459 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5222b864-b109-4302-99e9-b82a75080baa tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.145594 Aug 30 14:44:23.966268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 17/27] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:23 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:23.979660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-852606947", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeb2ec1e-a5f8-4f44-849b-b5b5a0519a69"}], "security_groups": [{"name": "tempest-securitygroup--400087857"}], "key_name": "tempest-keypair-1836101936", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:24.113409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:44:24.114040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:44:24.115628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:44:24.116108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:44:24.116513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:44:24.146045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:24.148948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:24.150130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:24.151489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:24.157029 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:24.157820 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:24.236630 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Getting quotas for project 7914879d13ad4a589f93b0ce22538d06. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:24.246806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Getting quotas for user ee02494e189d4823ab776ea3da9fd2ee and project 7914879d13ad4a589f93b0ce22538d06. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:24.289670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:44:24.296200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:44:24.455449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4d80da26-395c-48c2-87ce-7c6600dcc35d tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.185986 Aug 30 14:44:24.465747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 11/28] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:44:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:44:24.475668 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] validate_networks() for [('aeb2ec1e-a5f8-4f44-849b-b5b5a0519a69', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:44:24.480416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-75795f1f-50a5-47f0-bea7-6666b8714b5a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:24.481097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-75795f1f-50a5-47f0-bea7-6666b8714b5a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:25.066247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-75795f1f-50a5-47f0-bea7-6666b8714b5a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:25.091734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-75795f1f-50a5-47f0-bea7-6666b8714b5a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1222 microversion: 2.1 time: 0.624618 Aug 30 14:44:25.108584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 12/29] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:24 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1222 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:25.108584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5b0340e0-e6fa-48ad-95e4-3fb9949127ba tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:25.108584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5b0340e0-e6fa-48ad-95e4-3fb9949127ba tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:25.255626 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5b0340e0-e6fa-48ad-95e4-3fb9949127ba tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:25.268863 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5b0340e0-e6fa-48ad-95e4-3fb9949127ba tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1215 microversion: 2.1 time: 0.168914 Aug 30 14:44:25.270125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 13/30] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:25 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:25.284745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c082955e-f4f7-4645-88dc-01248b521086 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a69680d0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:25.381908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c082955e-f4f7-4645-88dc-01248b521086 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.110116 Aug 30 14:44:25.383253 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 14/31] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:25 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:25.424285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-174602380", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aee61467-aaf5-4b5d-929d-b8c24c2240c9"}], "security_groups": [{"name": "tempest-securitygroup--1521550004"}], "key_name": "tempest-keypair-964371602", "user_data": "}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:25.995697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] validate_networks() for [('aee61467-aaf5-4b5d-929d-b8c24c2240c9', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:44:26.272404 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:44:26.273330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:44:26.273899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:44:26.274508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:44:26.274978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:44:26.292830 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:26.294039 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:26.294988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:26.296686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:26.297583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:26.298772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:26.351960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:26.367847 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for user 521cc5ea8fb045bc81e8e3bfa8ba239b and project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:26.408560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:44:26.419738 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:44:26.529732 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0850a671-8fc7-4c4f-9c9c-10f90b3576ca tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.560323 Aug 30 14:44:26.531829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 18/32] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 14:44:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 14:44:26.538271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:26.539564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:26.549236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:26.550163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:26.550859 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:26.551849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:26.552762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:26.553509 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:26.942847 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:26.977170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-78ec305c-68c4-4ae1-a086-347859815a46 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1226 microversion: 2.1 time: 0.443210 Aug 30 14:44:26.978479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 19/33] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:26 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1226 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:26.990998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:26.994392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:27.014235 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:27.018903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:27.019792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:27.021114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:27.021836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:27.023421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:27.256631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:44:27.257460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:44:27.257587 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:44:27.257932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:44:27.259091 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:44:27.259450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:27.284215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:27.284729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:27.285179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:27.286047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:27.287101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:27.287698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:27.302181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4a53aa7a-72c5-4762-af48-085d2f2ac902 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1211 microversion: 2.1 time: 0.319145 Aug 30 14:44:27.305630 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 20/34] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:26 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1211 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:27.324715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-56ed92d7-d81c-4b67-9ee8-00e4d2f32dc9 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a68aca60>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:27.353195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:27.368635 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for user a1b3f34373414c61b94e2a8d9018cbd5 and project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:27.433468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:44:27.436784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:44:27.550551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-56ed92d7-d81c-4b67-9ee8-00e4d2f32dc9 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 200 len: 287 microversion: 2.1 time: 0.243082 Aug 30 14:44:27.559106 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 21/35] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:27 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 287 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:27.561578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e765cd07-b749-462f-a966-fae67b4a1c7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:27.568420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e765cd07-b749-462f-a966-fae67b4a1c7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:27.596476 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7f668536-ab03-43e4-8541-6645de95c86f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.205807 Aug 30 14:44:27.600179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 15/36] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:44:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:44:27.647711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0932646b-afc9-4091-a491-53f76976aed0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:27.651062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0932646b-afc9-4091-a491-53f76976aed0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:27.935764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0932646b-afc9-4091-a491-53f76976aed0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:27.950460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0932646b-afc9-4091-a491-53f76976aed0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1236 microversion: 2.1 time: 0.334961 Aug 30 14:44:27.961037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 16/37] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:27 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1236 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:28.028103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:28.031956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:28.071921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.072456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.072904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.073655 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.074120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.074562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.171155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e765cd07-b749-462f-a966-fae67b4a1c7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.217206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e765cd07-b749-462f-a966-fae67b4a1c7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.227491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e765cd07-b749-462f-a966-fae67b4a1c7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.229627 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e765cd07-b749-462f-a966-fae67b4a1c7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1281 microversion: 2.20 time: 0.672652 Aug 30 14:44:28.269725 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 22/38] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:27 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1281 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:28.340638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:28.341263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:28.362311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.362852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.363289 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.368538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.369345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.369799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.705581 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.735220 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0fba2cba-051d-40eb-8c2a-62d6baba7935 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1267 microversion: 2.1 time: 0.399632 Aug 30 14:44:28.738195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 23/39] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:28 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:28.743802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e8829f36-d86b-482d-b4d6-dd79e1dce551 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a68ac550>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:28.789784 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-e8829f36-d86b-482d-b4d6-dd79e1dce551 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] HTTP exception thrown: Snapshot 76dc59a1-46b1-43a7-ad2b-97304cc26350 could not be found. Aug 30 14:44:28.796373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e8829f36-d86b-482d-b4d6-dd79e1dce551 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Request method failure captured: Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 HTTP/1.1 Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiIwo1vePFvYQFaVZA-yyvEN7etvuzUa6EC9VdBq5aRe2i7PLH8bh54PYG9huIE1iEsfSOKOa8LJKcRtolOE_3F0DiJnyiLWttuH7IQg-tExKr9PF430rUiMHo6rnh2esD0UUyXJwqNJ0k8AH1HEbI_fR-yEGb135RUD2lBHKAMr3fE Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:44:28.803649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43b22599d66943c9919661ab4cd4a010", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 23deaaf412e64ba1bf53ed9e3a58fc70 Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Snapshot 76dc59a1-46b1-43a7-ad2b-97304cc26350 could not be found. Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '76dc59a1-46b1-43a7-ad2b-97304cc26350'} Aug 30 14:44:28.805126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 76dc59a1-46b1-43a7-ad2b-97304cc26350 could not be found. (HTTP 404) (Request-ID: req-ba3614ae-9646-4139-9a3c-6e238a2316f3) Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:28.805886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:28.806869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 76dc59a1-46b1-43a7-ad2b-97304cc26350 could not be found. Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 14:44:28.808588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 76dc59a1-46b1-43a7-ad2b-97304cc26350 could not be found. Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 76dc59a1-46b1-43a7-ad2b-97304cc26350 could not be found. Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e8829f36-d86b-482d-b4d6-dd79e1dce551 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Returning 404 to user: Snapshot 76dc59a1-46b1-43a7-ad2b-97304cc26350 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:28.810529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e8829f36-d86b-482d-b4d6-dd79e1dce551 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350" status: 404 len: 111 microversion: 2.1 time: 0.065970 Aug 30 14:44:28.813323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 24/40] 10.222.0.25 () {58 vars in 1251 bytes} [Tue Aug 30 14:44:28 2022] GET /compute/v2.1/os-snapshots/76dc59a1-46b1-43a7-ad2b-97304cc26350 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:44:28.818769 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-da5ad7fa-1b5e-4f02-8798-cdcbe2c2fdd8 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a68a5d30>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:28.838350 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e4c8e481-576d-4734-8df9-ecc59b52d4b8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1274 microversion: 2.1 time: 0.827047 Aug 30 14:44:28.856558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 17/41] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:28 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1274 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:28.862845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7ef63cd1-db59-4c45-b1df-51925349b0a6 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a68a28b0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:29.069089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-da5ad7fa-1b5e-4f02-8798-cdcbe2c2fdd8 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/9b6dcada-6cd8-440a-addb-985e4dba9f2c" status: 200 len: 351 microversion: 2.1 time: 0.253649 Aug 30 14:44:29.069969 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 25/42] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:44:28 2022] GET /compute/v2.1/os-volumes/9b6dcada-6cd8-440a-addb-985e4dba9f2c => generated 351 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:29.095242 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6c04c0a0-dd27-4690-9960-2f2cb3b056a4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:29.099300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6c04c0a0-dd27-4690-9960-2f2cb3b056a4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:29.210237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7ef63cd1-db59-4c45-b1df-51925349b0a6 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d" status: 202 len: 0 microversion: 2.1 time: 0.351999 Aug 30 14:44:29.210851 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 18/43] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:44:28 2022] DELETE /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:44:29.230206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b093c589-0cf0-47cc-be57-8b2d53357076 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a68b83a0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:29.336790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6c04c0a0-dd27-4690-9960-2f2cb3b056a4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:29.360152 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6c04c0a0-dd27-4690-9960-2f2cb3b056a4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1236 microversion: 2.1 time: 0.287453 Aug 30 14:44:29.386047 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 26/44] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:29 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1236 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:29.413616 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:29.415301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:29.462022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:29.466747 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:29.469443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:29.471404 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:29.477761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:29.479914 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:29.652844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-b093c589-0cf0-47cc-be57-8b2d53357076 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] HTTP exception thrown: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b093c589-0cf0-47cc-be57-8b2d53357076 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Request method failure captured: Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d HTTP/1.1 Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiIwo1vePFvYQFaVZA-yyvEN7etvuzUa6EC9VdBq5aRe2i7PLH8bh54PYG9huIE1iEsfSOKOa8LJKcRtolOE_3F0DiJnyiLWttuH7IQg-tExKr9PF430rUiMHo6rnh2esD0UUyXJwqNJ0k8AH1HEbI_fR-yEGb135RUD2lBHKAMr3fE Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:44:29.682136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43b22599d66943c9919661ab4cd4a010", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 23deaaf412e64ba1bf53ed9e3a58fc70 Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '46cd2b7f-36db-4a01-bb51-1f87af0b178d'} Aug 30 14:44:29.683426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. (HTTP 404) (Request-ID: req-e1264af1-d663-44c1-b702-c9b41abf2ca9) Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:29.684130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:29.685152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 14:44:29.686331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:29.688938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:29.690739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b093c589-0cf0-47cc-be57-8b2d53357076 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Returning 404 to user: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:29.695756 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b093c589-0cf0-47cc-be57-8b2d53357076 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d" status: 404 len: 109 microversion: 2.1 time: 0.475959 Aug 30 14:44:29.701631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 19/45] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:44:29 2022] GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d => generated 109 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 14:44:29.744141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9b605121-5a23-43af-99b9-99b1987bb686 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a68265e0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:30.079952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.093072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-9b605121-5a23-43af-99b9-99b1987bb686 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] HTTP exception thrown: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.104552 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.108641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9b605121-5a23-43af-99b9-99b1987bb686 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Request method failure captured: Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d HTTP/1.1 Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiIwo1vePFvYQFaVZA-yyvEN7etvuzUa6EC9VdBq5aRe2i7PLH8bh54PYG9huIE1iEsfSOKOa8LJKcRtolOE_3F0DiJnyiLWttuH7IQg-tExKr9PF430rUiMHo6rnh2esD0UUyXJwqNJ0k8AH1HEbI_fR-yEGb135RUD2lBHKAMr3fE Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:44:30.108935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43b22599d66943c9919661ab4cd4a010", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 23deaaf412e64ba1bf53ed9e3a58fc70 Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '46cd2b7f-36db-4a01-bb51-1f87af0b178d'} Aug 30 14:44:30.110409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. (HTTP 404) (Request-ID: req-10a49632-ae2a-4856-b925-10d16271841b) Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:30.111144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:44:30.112731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 14:44:30.113861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9b605121-5a23-43af-99b9-99b1987bb686 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Returning 404 to user: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:30.114951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9b605121-5a23-43af-99b9-99b1987bb686 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d" status: 404 len: 109 microversion: 2.1 time: 0.398075 Aug 30 14:44:30.119349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9363bd8a-4898-4051-9d48-c22fc5e63101 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1333 microversion: 2.20 time: 0.731333 Aug 30 14:44:30.123800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 27/46] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:29 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1333 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:30.133431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 20/47] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:44:29 2022] DELETE /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d => generated 109 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:44:30.145921 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:30.147447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:30.163654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.166889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.168142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.169474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.176435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.177708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.182421 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:30.183498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:30.264970 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.265906 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.266717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.267982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.285684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.286471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.376501 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.393108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d2049ec8-9709-402c-9fcb-9acf37021a90 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1275 microversion: 2.1 time: 0.265484 Aug 30 14:44:30.396710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 28/48] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:30 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1275 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:30.414100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-57695e85-535d-462c-90a9-84afcee19162 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Calling method '.version_select at 0x7fe6a680a940>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:30.489306 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.514908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8b9791ee-61df-457f-81e9-e8526fce2289 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1292 microversion: 2.1 time: 0.381268 Aug 30 14:44:30.517837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 21/49] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:30 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1292 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:30.543294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:30.547553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:30.571254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.573454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.576382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.578174 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.579218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.582376 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.720036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-57695e85-535d-462c-90a9-84afcee19162 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] HTTP exception thrown: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-57695e85-535d-462c-90a9-84afcee19162 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Request method failure captured: Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d HTTP/1.1 Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiIwo1vePFvYQFaVZA-yyvEN7etvuzUa6EC9VdBq5aRe2i7PLH8bh54PYG9huIE1iEsfSOKOa8LJKcRtolOE_3F0DiJnyiLWttuH7IQg-tExKr9PF430rUiMHo6rnh2esD0UUyXJwqNJ0k8AH1HEbI_fR-yEGb135RUD2lBHKAMr3fE Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:44:30.724206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/43b22599d66943c9919661ab4cd4a010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_43b22599d66943c9919661ab4cd4a010", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 43b22599d66943c9919661ab4cd4a010 Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1627713994 Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 23deaaf412e64ba1bf53ed9e3a58fc70 Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1627713994-project Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '46cd2b7f-36db-4a01-bb51-1f87af0b178d'} Aug 30 14:44:30.725516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. (HTTP 404) (Request-ID: req-83a27fbe-5663-4875-8a33-8fe17c75486e) Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:30.726192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:30.727217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 14:44:30.728228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. Aug 30 14:44:30.730309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:30.732679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-57695e85-535d-462c-90a9-84afcee19162 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] Returning 404 to user: Volume 46cd2b7f-36db-4a01-bb51-1f87af0b178d could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:30.735597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-57695e85-535d-462c-90a9-84afcee19162 tempest-VolumesSnapshotsTestJSON-1627713994 tempest-VolumesSnapshotsTestJSON-1627713994-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d" status: 404 len: 109 microversion: 2.1 time: 0.336925 Aug 30 14:44:30.736616 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 29/50] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:44:30 2022] GET /compute/v2.1/os-volumes/46cd2b7f-36db-4a01-bb51-1f87af0b178d => generated 109 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:44:30.952516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.986451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-982cb818-d112-4598-9cd1-96bc3bcc5fa8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1232 microversion: 2.1 time: 0.461750 Aug 30 14:44:31.009509 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 22/51] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:30 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1232 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:31.173124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:31.174131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:31.194586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.197793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.199860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.202006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.206168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.206835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.441918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:31.442850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:31.469343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.470708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.471334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.472415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.474646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.475262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.643163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.682887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.696580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.698778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cef84ffa-5d61-4a17-87c7-7f39f9965629 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1341 microversion: 2.20 time: 0.530291 Aug 30 14:44:31.711443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 30/52] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:31 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1341 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:31.734539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:31.737370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:31.766515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.767116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.767488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.771973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.772498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.772945 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.880767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.891242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b2377393-6603-41f3-8414-200e0b18eb05 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1273 microversion: 2.1 time: 0.454995 Aug 30 14:44:31.896880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 23/53] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:31 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:32.020481 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:32.021467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:32.043653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.046377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.052961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:32.060588 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.065447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.066391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:32.085493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:32.119781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-31f288f5-b212-4eaa-9cbb-1b5beba86249 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1280 microversion: 2.1 time: 0.404817 Aug 30 14:44:32.121134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 31/54] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:31 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1280 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:32.324892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7290cb1b-fa5a-4269-a4c1-2cafc80b6566 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a67e24c0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:32.483896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7290cb1b-fa5a-4269-a4c1-2cafc80b6566 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bc31b2c7-00b0-406e-a604-3913110fa344" status: 200 len: 351 microversion: 2.1 time: 0.171860 Aug 30 14:44:32.485149 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 32/55] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:44:32 2022] GET /compute/v2.1/os-volumes/bc31b2c7-00b0-406e-a604-3913110fa344 => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:32.509938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2e00a475-8c86-43c1-aa04-4488d90c52b0 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a68ac160>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:32.802849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2e00a475-8c86-43c1-aa04-4488d90c52b0 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.306214 Aug 30 14:44:32.806035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 33/56] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Aug 30 14:44:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:32.824964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:32.827559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:32.844174 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.848181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.849491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:32.851466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.853510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.854717 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.093562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.147198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d222199f-039a-44ea-8ce5-590612e12fc5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1288 microversion: 2.1 time: 1.135517 Aug 30 14:44:33.153017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 24/57] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:32 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1288 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:33.184286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-50f13af9-98ce-4ce0-b806-26e2d56e7688 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a67d8dc0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:33.296893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.323509 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.325510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.331975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-28019185-d5f2-4157-8571-559cf4ad8d48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1339 microversion: 2.20 time: 0.519687 Aug 30 14:44:33.333257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 34/58] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:32 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1339 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:33.339879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:33.340890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:33.363697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:33.365703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:33.366146 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.366893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:33.367332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:33.377374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.437203 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-50f13af9-98ce-4ce0-b806-26e2d56e7688 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.282753 Aug 30 14:44:33.438428 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 25/59] 10.222.0.25 () {58 vars in 1149 bytes} [Tue Aug 30 14:44:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:33.444135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:33.449664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:33.472052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:33.472863 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:33.473707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.478410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:33.478994 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:33.480206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.658011 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.671062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7e6a988f-78f7-4671-a7e9-9cc37f56238e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1273 microversion: 2.1 time: 0.336429 Aug 30 14:44:33.674489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 35/60] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:33 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1273 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:33.682802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-22cb6313-ecc7-48ea-99c0-42119c882ef7 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a68acd30>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:33.928955 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-22cb6313-ecc7-48ea-99c0-42119c882ef7 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.252666 Aug 30 14:44:33.930430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 36/61] 10.222.0.25 () {58 vars in 1134 bytes} [Tue Aug 30 14:44:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:33.965239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-400528e7-94dd-4f09-9d95-8c811f0fff6d tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a67e2d30>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:33.973887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.994710 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f8485438-65d6-42c0-bb58-a96921608afa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1280 microversion: 2.1 time: 0.554555 Aug 30 14:44:34.011058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 26/62] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:33 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1280 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:34.189077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.199859 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:34.233982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.234519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.240978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.251021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.251457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.253307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.263192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-400528e7-94dd-4f09-9d95-8c811f0fff6d tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.315704 Aug 30 14:44:34.264025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 37/63] 10.222.0.25 () {58 vars in 1167 bytes} [Tue Aug 30 14:44:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:34.292413 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d710fca2-ed5d-4332-b018-bd5bda6c1c0d tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a6884430>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.660466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d710fca2-ed5d-4332-b018-bd5bda6c1c0d tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.376561 Aug 30 14:44:34.662008 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 38/64] 10.222.0.25 () {58 vars in 1170 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:34.675026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.680585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:34.696894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.697879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.698650 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.699636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.700593 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.701301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.766373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:34.777724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a28d8858-a0a9-4763-832c-3b2f3714dacc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1288 microversion: 2.1 time: 0.601966 Aug 30 14:44:34.787089 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 27/65] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1288 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:34.793243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-75592f51-25ad-47d2-8a60-0bdb1370feb2 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a67d8ee0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.960912 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-75592f51-25ad-47d2-8a60-0bdb1370feb2 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.172489 Aug 30 14:44:34.962935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 28/66] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:34.970805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.972418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:34.972875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:34.982500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.983329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.984441 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.985457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.986693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.987411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.990365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.001145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.008498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cdd49f90-fa41-4e4b-ac4c-d498e619ec37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1339 microversion: 2.20 time: 0.343872 Aug 30 14:44:35.012945 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 39/67] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1339 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:35.039242 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6523799b-ded9-4453-9244-e3a056ffeafb tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a67e2c10>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:35.138301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.155187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3d40acb5-89cc-496d-a87b-5c3b7b4841d7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1273 microversion: 2.1 time: 0.190365 Aug 30 14:44:35.156163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 29/68] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:35.169452 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:35.171421 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:35.245554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.250614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.253830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.257772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.262012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.267588 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.365072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6523799b-ded9-4453-9244-e3a056ffeafb tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.346959 Aug 30 14:44:35.366619 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 40/69] 10.222.0.25 () {58 vars in 1188 bytes} [Tue Aug 30 14:44:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:35.381782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fe12fefc-d20e-47c1-85cf-fbc8ffe5db87 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] Calling method '.version_select at 0x7fe6a67b9c10>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:35.613889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.635160 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fa509066-04a5-4cd6-9c73-347aa7dc2062 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1280 microversion: 2.1 time: 0.471408 Aug 30 14:44:35.652250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 30/70] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:35 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1280 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:35.812803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fe12fefc-d20e-47c1-85cf-fbc8ffe5db87 tempest-VolumesTestJSON-567970839 tempest-VolumesTestJSON-567970839-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.435099 Aug 30 14:44:35.813583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 41/71] 10.222.0.25 () {58 vars in 1155 bytes} [Tue Aug 30 14:44:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:35.819575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:35.829365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:35.860489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.860992 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.861429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.862162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.862625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.863053 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.131836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.144681 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1aa7b712-2c16-44cc-a793-3a76549ba202 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1288 microversion: 2.1 time: 0.329747 Aug 30 14:44:36.145730 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 42/72] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:35 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1288 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:36.156711 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:36.172203 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:36.192195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.197628 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.199027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.203077 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.205076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.208623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.233617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-02fcebaf-2436-419c-8bc3-e859388c60f4 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Action: 'create', calling method: .version_select at 0x7fe6a6846670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1034428286", "metadata": {"Type": "work"}}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-02fcebaf-2436-419c-8bc3-e859388c60f4 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Request method failure captured: Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 122 Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJT0-UVRX9Vs2Sh51_i0GPxS-mKna0-jw_BCck8CgcAqyQyKm75Tboh6nAYezqSmbvNwnqoj6tjNPpNJEZHm6jMmTmlsnNnQsU3B7yRcDIuP4zbt0hcZVW0yFcqTNY9Hk1Odb9SvWaoLd1gnnfcWbNTP0ixBVt9h_iGye2ujcDOp-M Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:44:36.244288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c3c148a4cc4f93a6b75a4fa10cae44", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 5b14af6fb579472593035910027a13f7 Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1034428286", "metadata": {"Type": "work"}}} Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: Aug 30 14:44:36.246161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1034428286', 'metadata': {'Type': 'work'}}}} Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise error Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:36.246883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 14:44:36.248183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 14:44:36.249887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 14:44:36.249887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.253224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-02fcebaf-2436-419c-8bc3-e859388c60f4 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:36.257345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-02fcebaf-2436-419c-8bc3-e859388c60f4 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.533844 Aug 30 14:44:36.262750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 31/73] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 14:44:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:44:36.280316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:36.281284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:36.310647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.311212 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.311647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.312757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.313210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.313721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.331825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:36.403674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.419906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.422705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.425407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-96df166c-02af-421f-a770-887942a23e3b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1339 microversion: 2.20 time: 0.277250 Aug 30 14:44:36.440049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 43/74] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:36 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1339 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:36.440049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f680dc1b-e056-491a-8a6d-38531d18d358 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Action: 'create', calling method: .version_select at 0x7fe6a67e2a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1773295210", "metadata": {"Type": "work"}}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f680dc1b-e056-491a-8a6d-38531d18d358 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Request method failure captured: Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 120 Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJT0-UVRX9Vs2Sh51_i0GPxS-mKna0-jw_BCck8CgcAqyQyKm75Tboh6nAYezqSmbvNwnqoj6tjNPpNJEZHm6jMmTmlsnNnQsU3B7yRcDIuP4zbt0hcZVW0yFcqTNY9Hk1Odb9SvWaoLd1gnnfcWbNTP0ixBVt9h_iGye2ujcDOp-M Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:44:36.493108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c3c148a4cc4f93a6b75a4fa10cae44", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 5b14af6fb579472593035910027a13f7 Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1773295210", "metadata": {"Type": "work"}}} Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: Aug 30 14:44:36.501735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1773295210', 'metadata': {'Type': 'work'}}}} Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise error Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi '0' Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:36.503305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 14:44:36.506370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 14:44:36.509908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 14:44:36.509908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.509908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f680dc1b-e056-491a-8a6d-38531d18d358 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:36.509908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f680dc1b-e056-491a-8a6d-38531d18d358 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.063149 Aug 30 14:44:36.509908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 44/75] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 14:44:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:44:36.516593 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-84425111-0583-4930-b554-9f123f2caba0 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Action: 'create', calling method: .version_select at 0x7fe6a68ac3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-596404760", "metadata": {"Type": "work"}}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-84425111-0583-4930-b554-9f123f2caba0 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Request method failure captured: Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 118 Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJT0-UVRX9Vs2Sh51_i0GPxS-mKna0-jw_BCck8CgcAqyQyKm75Tboh6nAYezqSmbvNwnqoj6tjNPpNJEZHm6jMmTmlsnNnQsU3B7yRcDIuP4zbt0hcZVW0yFcqTNY9Hk1Odb9SvWaoLd1gnnfcWbNTP0ixBVt9h_iGye2ujcDOp-M Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:44:36.520933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c3c148a4cc4f93a6b75a4fa10cae44", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 5b14af6fb579472593035910027a13f7 Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-596404760", "metadata": {"Type": "work"}}} Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: Aug 30 14:44:36.522411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-596404760', 'metadata': {'Type': 'work'}}}} Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise error Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi '' Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:36.523264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 14:44:36.524685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 14:44:36.525853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 14:44:36.525853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.528177 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-84425111-0583-4930-b554-9f123f2caba0 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:36.529710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-84425111-0583-4930-b554-9f123f2caba0 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021914 Aug 30 14:44:36.531857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 45/76] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 14:44:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 14:44:36.543453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a5a44b8f-c1ee-4ccd-a4b3-807e3a3964f6 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Calling method '.version_select at 0x7fe6a68c3c10>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:36.610278 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-a5a44b8f-c1ee-4ccd-a4b3-807e3a3964f6 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] HTTP exception thrown: Volume tempest-invalid-133255222 could not be found. Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a5a44b8f-c1ee-4ccd-a4b3-807e3a3964f6 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Request method failure captured: Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-133255222 HTTP/1.1 Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJT0-UVRX9Vs2Sh51_i0GPxS-mKna0-jw_BCck8CgcAqyQyKm75Tboh6nAYezqSmbvNwnqoj6tjNPpNJEZHm6jMmTmlsnNnQsU3B7yRcDIuP4zbt0hcZVW0yFcqTNY9Hk1Odb9SvWaoLd1gnnfcWbNTP0ixBVt9h_iGye2ujcDOp-M Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:44:36.613745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c3c148a4cc4f93a6b75a4fa10cae44", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 5b14af6fb579472593035910027a13f7 Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Volume tempest-invalid-133255222 could not be found. Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'tempest-invalid-133255222'} Aug 30 14:44:36.616094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-133255222 could not be found. (HTTP 404) (Request-ID: req-eb9c3167-11f6-4442-8fff-68c371001b5b) Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.617422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:44:36.619356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-133255222 could not be found. Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:44:36.624978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-133255222 could not be found. Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-133255222 could not be found. Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a5a44b8f-c1ee-4ccd-a4b3-807e3a3964f6 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Returning 404 to user: Volume tempest-invalid-133255222 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a5a44b8f-c1ee-4ccd-a4b3-807e3a3964f6 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-133255222" status: 404 len: 98 microversion: 2.1 time: 0.076596 Aug 30 14:44:36.642715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 46/77] 10.222.0.25 () {58 vars in 1215 bytes} [Tue Aug 30 14:44:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-133255222 => generated 98 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 14:44:36.661896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ee11273c-bb6f-4352-ad92-42e93c89b763 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016107 Aug 30 14:44:36.665195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 47/78] 10.222.0.25 () {58 vars in 1140 bytes} [Tue Aug 30 14:44:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 14:44:36.723801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6c1cf158-87dc-45e0-ae9a-fb697089425a tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.036269 Aug 30 14:44:36.743281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 48/79] 10.222.0.25 () {58 vars in 1137 bytes} [Tue Aug 30 14:44:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 14:44:36.788987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:36.797046 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:36.905293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.906180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.914203 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.936397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.941091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.943052 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.323336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:37.703086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:37.727893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:37.743818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bcd2ed68-9f40-4955-8ccb-ea819f845ed6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.998809 Aug 30 14:44:37.751438 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 49/80] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:36 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:37.775426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-72490aad-ba92-4658-adce-4e806acb4c02 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 1.510212 Aug 30 14:44:37.785423 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0c4716d-f373-4c45-851f-6a9553cf8222 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Calling method '.version_select at 0x7fe6a68c3c10>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:37.796352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 32/81] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:36 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:37.814290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:37.819581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:37.859621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.861695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.866409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.870680 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.872527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.873881 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.942177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=24 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:37.952073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-d0c4716d-f373-4c45-851f-6a9553cf8222 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] HTTP exception thrown: Volume 8538e956-8922-48ea-9c34-8223eff10103 could not be found. Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0c4716d-f373-4c45-851f-6a9553cf8222 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Request method failure captured: Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/os-volumes/8538e956-8922-48ea-9c34-8223eff10103 HTTP/1.1 Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJT0-UVRX9Vs2Sh51_i0GPxS-mKna0-jw_BCck8CgcAqyQyKm75Tboh6nAYezqSmbvNwnqoj6tjNPpNJEZHm6jMmTmlsnNnQsU3B7yRcDIuP4zbt0hcZVW0yFcqTNY9Hk1Odb9SvWaoLd1gnnfcWbNTP0ixBVt9h_iGye2ujcDOp-M Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:44:37.954885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c3c148a4cc4f93a6b75a4fa10cae44", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 5b14af6fb579472593035910027a13f7 Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Volume 8538e956-8922-48ea-9c34-8223eff10103 could not be found. Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '8538e956-8922-48ea-9c34-8223eff10103'} Aug 30 14:44:37.957498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8538e956-8922-48ea-9c34-8223eff10103 could not be found. (HTTP 404) (Request-ID: req-c6f4d01a-03f6-426d-b0c5-b57c0c3ca66a) Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:37.958799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:44:37.964938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8538e956-8922-48ea-9c34-8223eff10103 could not be found. Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 14:44:37.969150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8538e956-8922-48ea-9c34-8223eff10103 could not be found. Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8538e956-8922-48ea-9c34-8223eff10103 could not be found. Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0c4716d-f373-4c45-851f-6a9553cf8222 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Returning 404 to user: Volume 8538e956-8922-48ea-9c34-8223eff10103 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d0c4716d-f373-4c45-851f-6a9553cf8222 tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/8538e956-8922-48ea-9c34-8223eff10103" status: 404 len: 109 microversion: 2.1 time: 0.204271 Aug 30 14:44:37.974614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 50/82] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:44:37 2022] DELETE /compute/v2.1/os-volumes/8538e956-8922-48ea-9c34-8223eff10103 => generated 109 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:44:37.977418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:37.977418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:37.991227 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.995816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.997245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.999245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.000653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.002571 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.493813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:38.558721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-adbf53e3-7474-41ea-b3fd-79282fc98af5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1294 microversion: 2.1 time: 0.759551 Aug 30 14:44:38.568671 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 33/83] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:37 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1294 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:38.611181 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-92ac3bed-3eb9-4483-9290-5fbe71cfc65c tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Calling method '.version_select at 0x7fe6a67fee50>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:38.718207 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:38.726000 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-92ac3bed-3eb9-4483-9290-5fbe71cfc65c tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] HTTP exception thrown: Volume 0608538c-070f-4959-96fe-65c1e4edd92a could not be found. Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-92ac3bed-3eb9-4483-9290-5fbe71cfc65c tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Request method failure captured: Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/os-volumes/0608538c-070f-4959-96fe-65c1e4edd92a HTTP/1.1 Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJT0-UVRX9Vs2Sh51_i0GPxS-mKna0-jw_BCck8CgcAqyQyKm75Tboh6nAYezqSmbvNwnqoj6tjNPpNJEZHm6jMmTmlsnNnQsU3B7yRcDIuP4zbt0hcZVW0yFcqTNY9Hk1Odb9SvWaoLd1gnnfcWbNTP0ixBVt9h_iGye2ujcDOp-M Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:44:38.732827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c9c3c148a4cc4f93a6b75a4fa10cae44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c9c3c148a4cc4f93a6b75a4fa10cae44", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: c9c3c148a4cc4f93a6b75a4fa10cae44 Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-VolumesNegativeTest-1992035167 Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 5b14af6fb579472593035910027a13f7 Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-VolumesNegativeTest-1992035167-project Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Volume 0608538c-070f-4959-96fe-65c1e4edd92a could not be found. Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '0608538c-070f-4959-96fe-65c1e4edd92a'} Aug 30 14:44:38.735472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0608538c-070f-4959-96fe-65c1e4edd92a could not be found. (HTTP 404) (Request-ID: req-6c5f2fdd-b006-4485-b049-8cc68ef9242d) Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:38.737138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:44:38.740736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0608538c-070f-4959-96fe-65c1e4edd92a could not be found. Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 14:44:38.745145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0608538c-070f-4959-96fe-65c1e4edd92a could not be found. Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0608538c-070f-4959-96fe-65c1e4edd92a could not be found. Aug 30 14:44:38.748945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:44:38.753615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-92ac3bed-3eb9-4483-9290-5fbe71cfc65c tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] Returning 404 to user: Volume 0608538c-070f-4959-96fe-65c1e4edd92a could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:38.759800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-92ac3bed-3eb9-4483-9290-5fbe71cfc65c tempest-VolumesNegativeTest-1992035167 tempest-VolumesNegativeTest-1992035167-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0608538c-070f-4959-96fe-65c1e4edd92a" status: 404 len: 109 microversion: 2.1 time: 0.178991 Aug 30 14:44:38.762522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 34/84] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:44:38 2022] GET /compute/v2.1/os-volumes/0608538c-070f-4959-96fe-65c1e4edd92a => generated 109 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:44:38.805521 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:38.810456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:38.811765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:38.825647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:38.833198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1819e1f2-5ad2-4148-bf25-5628128d02ad tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1339 microversion: 2.20 time: 0.872159 Aug 30 14:44:38.839330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 51/85] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:37 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1339 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:38.862334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:38.867882 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.868739 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:38.870784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.871247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.877543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.879281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.881119 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:38.881904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.901525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.908626 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.912210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.917215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.922791 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.924857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:39.354219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=26 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:40.703157 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:40.738839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1a353a21-229c-4a8c-8774-2ab72e6df9f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 1.969106 Aug 30 14:44:40.741286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 35/86] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:38 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:40.761369 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:40.772863 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:40.827415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:40.836824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:40.838933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:40.840576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:40.848199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:40.849516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.091793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:41.117748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-78918499-4d87-4f39-9170-7296a877b12a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1294 microversion: 2.1 time: 0.374502 Aug 30 14:44:41.120708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 36/87] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:40 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1294 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:41.127166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:41.128175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:41.137124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.138154 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.139250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.141125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.143368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.144440 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.711447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:41.743843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2d10735a-0a5d-4e7f-a447-92f3a2cdf161 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 2.901999 Aug 30 14:44:41.754491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 52/88] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:38 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 2914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:41.780748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:41.782660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:41.818282 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.819440 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.820275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.825863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.835756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.837506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.306542 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.317902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.337848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.344248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-17500a1d-6093-4d84-8017-fc437f68de4f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 1.221438 Aug 30 14:44:42.356739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 37/89] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:41 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:42.382497 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:42.383318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:42.399207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.412835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.413838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.414996 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.415797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.416505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.630905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.643207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-744dca90-3bfb-4df8-897f-9a4bd8d886f8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1294 microversion: 2.1 time: 0.274020 Aug 30 14:44:42.661065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 38/90] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:42 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1294 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:42.801667 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:42.802698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:42.810596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.815705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.816406 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.816948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.818017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.818596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.819124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.819493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:42.846083 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05934250-027d-4096-8a3e-f12551f149b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 1.083607 Aug 30 14:44:42.848528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 53/91] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:41 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:42.881986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:43.128276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-e21c2ccd-a8d5-4f6b-8e16-d91a0f32115a req-1972ffab-ed3d-46b9-9581-f3dd504e0fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7370a3a-e107-40f2-b532-5bc089b157e8", "tag": "0c6380b4-099c-44ab-8d72-4d08a77e7849"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:43.163271 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.175630 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8e4c713b-584e-47af-a60b-c8319583331c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.378276 Aug 30 14:44:43.176277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 39/92] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:42 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:43.206085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e21c2ccd-a8d5-4f6b-8e16-d91a0f32115a req-1972ffab-ed3d-46b9-9581-f3dd504e0fea service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.206936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e21c2ccd-a8d5-4f6b-8e16-d91a0f32115a req-1972ffab-ed3d-46b9-9581-f3dd504e0fea service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.207941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e21c2ccd-a8d5-4f6b-8e16-d91a0f32115a req-1972ffab-ed3d-46b9-9581-f3dd504e0fea service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.251529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-e21c2ccd-a8d5-4f6b-8e16-d91a0f32115a req-1972ffab-ed3d-46b9-9581-f3dd504e0fea service nova] Creating event network-changed:0c6380b4-099c-44ab-8d72-4d08a77e7849 for instance c7370a3a-e107-40f2-b532-5bc089b157e8 on hv-cinder-82880 Aug 30 14:44:43.252499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e21c2ccd-a8d5-4f6b-8e16-d91a0f32115a req-1972ffab-ed3d-46b9-9581-f3dd504e0fea service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 14:44:43.253199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e21c2ccd-a8d5-4f6b-8e16-d91a0f32115a req-1972ffab-ed3d-46b9-9581-f3dd504e0fea service nova] Acquired lock "compute-rpcapi-router" {{(pid=127177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 14:44:43.255232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.256095 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.257098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.258720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.259546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.260565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.283882 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.compute.rpcapi [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 14:44:43.286032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] Releasing lock "compute-rpcapi-router" {{(pid=127177) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 14:44:43.332091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b9a2db3c-1d5f-4a56-a283-4b6290267a86 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421655 Aug 30 14:44:43.333524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 54/93] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:43.402403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:43.403683 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:43.419374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.422392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.423148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.424507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.425184 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.425833 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.561999 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-7b614c47-9fec-4f37-b173-b03769949129 req-a6978b72-ea6f-41ab-8709-430cd5c8ec3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df889ee2-48d9-4b45-b6a3-64e3dc785b20", "tag": "48041a61-1681-47c7-a171-bba3d49197a2"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:43.593172 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7b614c47-9fec-4f37-b173-b03769949129 req-a6978b72-ea6f-41ab-8709-430cd5c8ec3f service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.593727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7b614c47-9fec-4f37-b173-b03769949129 req-a6978b72-ea6f-41ab-8709-430cd5c8ec3f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.594673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7b614c47-9fec-4f37-b173-b03769949129 req-a6978b72-ea6f-41ab-8709-430cd5c8ec3f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.621008 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-7b614c47-9fec-4f37-b173-b03769949129 req-a6978b72-ea6f-41ab-8709-430cd5c8ec3f service nova] Creating event network-changed:48041a61-1681-47c7-a171-bba3d49197a2 for instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 on hv-cinder-82880 Aug 30 14:44:43.621741 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7b614c47-9fec-4f37-b173-b03769949129 req-a6978b72-ea6f-41ab-8709-430cd5c8ec3f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127176) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 14:44:43.622335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7b614c47-9fec-4f37-b173-b03769949129 req-a6978b72-ea6f-41ab-8709-430cd5c8ec3f service nova] Acquired lock "compute-rpcapi-router" {{(pid=127176) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 14:44:43.631927 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.632698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.635925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.640515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.641470 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.642347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.668243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.compute.rpcapi [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 14:44:43.671939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127176) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 14:44:43.706530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-81777f52-6aef-4cd4-9948-b96784abcbb5 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.527253 Aug 30 14:44:43.706530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 40/94] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:43.714079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:43.714799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:43.724145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.724634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.725233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.726199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.726820 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.727400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.830673 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.848185 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.850958 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.853376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-90cea1f0-abca-454e-a4e0-c5eebcad3831 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.475693 Aug 30 14:44:43.855256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 55/95] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:43 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:43.871393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.873040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:43.876180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:43.886573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.887302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.888695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.889501 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.890103 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.890539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.901163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1d1b0470-4766-41c0-bd68-d71df3c54c60 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1294 microversion: 2.1 time: 0.191946 Aug 30 14:44:43.904294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 41/96] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:43 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1294 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:44.116312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:44.127327 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4bc45d76-45ce-4d08-ba4e-7fa4d9b5ef1f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.260783 Aug 30 14:44:44.143188 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 56/97] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:43 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:44.217438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:44.218552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:44.224355 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:44.231455 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.232318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.233148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.234630 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.235471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.236235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.457383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:44.466283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0804de5f-cdb1-421c-96c1-e985b47e6f99 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.256576 Aug 30 14:44:44.467089 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 42/98] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:44 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:44.898971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:44.899905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:44.917904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.918757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.919806 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.921699 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.922488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.935143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.957021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:44.958035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:44.991184 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.995103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.997000 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.002897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.004812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.006101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.155579 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.167555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a1005aa9-0879-4e67-afb2-93c90185a2e3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1294 microversion: 2.1 time: 0.217599 Aug 30 14:44:45.183823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 43/99] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:44 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1294 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:45.190457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:45.191341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:45.202726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.203717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.204624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.205701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.206333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.206908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.330122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.339855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.340660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.342738 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c8c9bf43-93ab-4c9f-919f-ef0c575f6400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.450982 Aug 30 14:44:45.344027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 57/100] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:44 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:45.354247 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-4250ff53-1ec6-415e-abcb-6fc594915865 req-cb180f3c-a1c9-4707-96f1-e3503d187a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec5ebea7-409d-4e00-9a26-030000cdb28b", "tag": "e3436675-e20f-493c-ac9e-bc8835e548ed"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:45.372804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4250ff53-1ec6-415e-abcb-6fc594915865 req-cb180f3c-a1c9-4707-96f1-e3503d187a06 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.373813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4250ff53-1ec6-415e-abcb-6fc594915865 req-cb180f3c-a1c9-4707-96f1-e3503d187a06 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.374132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4250ff53-1ec6-415e-abcb-6fc594915865 req-cb180f3c-a1c9-4707-96f1-e3503d187a06 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.393710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-4250ff53-1ec6-415e-abcb-6fc594915865 req-cb180f3c-a1c9-4707-96f1-e3503d187a06 service nova] Creating event network-changed:e3436675-e20f-493c-ac9e-bc8835e548ed for instance ec5ebea7-409d-4e00-9a26-030000cdb28b on hv-cinder-82880 Aug 30 14:44:45.400764 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-4250ff53-1ec6-415e-abcb-6fc594915865 req-cb180f3c-a1c9-4707-96f1-e3503d187a06 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050501 Aug 30 14:44:45.401654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 58/101] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:45.434416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.445278 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-28c634df-1ceb-4822-8006-71275e999e90 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.260006 Aug 30 14:44:45.446024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 44/102] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:45 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:45.504073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:45.504762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:45.513765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.514696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.515348 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.516299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.516920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.517839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.826722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.847158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1a19b0d7-fcce-427d-bb08-510aaeca1fa1 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.358994 Aug 30 14:44:45.848325 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 59/103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:45 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:46.192354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:46.193445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:46.220685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.221355 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.221861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.222640 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.223099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.228327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.397819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:46.402355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:46.430738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:46.445516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2ae94f71-35e4-4aa3-8dc2-59cd22c8ff55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1294 microversion: 2.1 time: 0.256592 Aug 30 14:44:46.446179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 45/104] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:46 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1294 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:46.457737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.464310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.467621 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.479448 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.485068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:46.485670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:46.486114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.487380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.510429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.510429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.510429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.510429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.511225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.511225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:48.969451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.000482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f94b14be-3fc0-4f11-a228-b3e8179cad17 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 2.518383 Aug 30 14:44:49.001429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 46/105] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:46 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 2522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:49.020487 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:49.022458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.042472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.045520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.048048 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.050128 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.052701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.054663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.267123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.290825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.305026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.305026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2ab26055-0a5d-4a29-b337-e457312b8fff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 2.917051 Aug 30 14:44:49.305026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 60/106] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:46 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 2920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:49.326973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:49.331225 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.343223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.344936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.345896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.347919 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.349250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.350273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.647745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.657078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f9662842-b064-4d2a-b458-6dc701ba818c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.651371 Aug 30 14:44:49.671957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 47/107] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:49 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:49.682283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-c9184e1f-2acb-420d-884f-a047ddec47b1 req-449c9901-e5bc-47ff-9509-4c5b18997b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1622c2-5c2a-4656-b39c-0f2f520fcf52", "tag": "cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:49.696352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c9184e1f-2acb-420d-884f-a047ddec47b1 req-449c9901-e5bc-47ff-9509-4c5b18997b77 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.697128 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c9184e1f-2acb-420d-884f-a047ddec47b1 req-449c9901-e5bc-47ff-9509-4c5b18997b77 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.697828 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c9184e1f-2acb-420d-884f-a047ddec47b1 req-449c9901-e5bc-47ff-9509-4c5b18997b77 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.714648 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-c9184e1f-2acb-420d-884f-a047ddec47b1 req-449c9901-e5bc-47ff-9509-4c5b18997b77 service nova] Creating event network-changed:cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1 for instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 on hv-cinder-82880 Aug 30 14:44:49.721608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-c9184e1f-2acb-420d-884f-a047ddec47b1 req-449c9901-e5bc-47ff-9509-4c5b18997b77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046546 Aug 30 14:44:49.722693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 48/108] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:49.786395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.795473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e991d77b-6d89-4802-ae3c-39765319f22e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.484586 Aug 30 14:44:49.801362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 61/109] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:49 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:50.031726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.035187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.050625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.051609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.052563 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.054432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.055702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.056967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.283641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.302561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-106a8fb2-4bc3-44b0-b9cc-0d71fb9c95d5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.281906 Aug 30 14:44:50.303509 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 49/110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:50.347805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.350244 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.362008 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.363085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.364184 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.365956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.367061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.368211 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.581194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.592229 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.595992 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.598617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8d45ba43-57b9-4a9e-9ed0-3afebd7f6689 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.259534 Aug 30 14:44:50.599356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 62/111] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:50.681743 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.682701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.693905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.694383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.695088 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.696330 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.697176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.697979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.825386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.827080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.837829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.839289 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.840800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.842914 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.844669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.845640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.934706 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.944748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ea884d22-cb4c-4573-a19f-b8b4ff0c4180 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.269546 Aug 30 14:44:50.945454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 50/112] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:51.104022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:51.117724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5537dc51-4db2-4cce-bd4a-6f7e3624923e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.300342 Aug 30 14:44:51.118443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 63/113] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:51.350641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:51.351895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:51.366953 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:51.367929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:51.369459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.370812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:51.371946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:51.373087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.626961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:51.627657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:51.629527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:51.652604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-51fd7b60-fd2f-402a-9a36-be80c6653b0a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.312719 Aug 30 14:44:51.671689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:51.672316 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:51.672642 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.673502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:51.673883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:51.675702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 51/114] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:51 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:51.675876 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.876025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:51.886148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:51.890941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:51.892693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4bbfce88-decb-4979-987f-4af7820cb02c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.270886 Aug 30 14:44:51.907696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 64/115] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:51 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:51.984447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:51.984447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:51.995112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:51.996594 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:51.997694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.999325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.000738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.001576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.157952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:52.159050 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:52.177625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.178272 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.178915 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.179859 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.180501 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.181144 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.310895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.321623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d754fa68-c7e6-40d1-a5f1-384e4fe5ab77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.346110 Aug 30 14:44:52.322918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 52/116] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:51 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:52.449223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.459581 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a2644f45-82b4-4947-b33b-35925dbfa89c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.308254 Aug 30 14:44:52.460232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 65/117] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:52 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:52.679074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:52.680508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:52.692786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.693368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.693856 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.694638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.695089 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.695726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.921753 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:52.923103 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:52.939841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.940851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.941544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.942773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.943400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.943828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.964037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.975791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-de40a241-31f8-4eae-a6d9-8b11c37b9b86 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.300869 Aug 30 14:44:52.976418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 53/118] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:52 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:53.276284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.280168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:53.295952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.299337 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.302310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ea7442e3-6463-4671-8fbb-b1ced686bac1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.388799 Aug 30 14:44:53.304254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 66/119] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:52 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:53.358298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:53.359742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:53.380744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.381515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.382470 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.384103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.385122 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.386022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.495077 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:53.501728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:53.522422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.525524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.526810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.527940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.528730 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.530190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.661349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:54.636357 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:54.666014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-94e3bb9f-2f9d-4cb1-ba25-27fd3f34f31e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 1.314563 Aug 30 14:44:54.670514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 54/120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:53 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:54.692679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:54.694160 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:54.714903 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.727567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.729192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:54.730827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.731964 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.733183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.513327 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:55.566755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bd08a135-5644-4ff8-bc78-34fb322bd0c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 2.087743 Aug 30 14:44:55.600861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 67/121] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:53 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:55.606720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:55.607358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:55.645969 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.646825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.650108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.651215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.658679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.660742 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.164544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.195115 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-55d1f1aa-f79c-46c5-8790-f231dc3e9bcf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 1.519560 Aug 30 14:44:56.201674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 55/122] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:54 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:56.221669 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:56.223346 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:56.238632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:56.240198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:56.242550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.243961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:56.244931 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:56.246069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.377599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.389600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.390951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.392962 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-098543b4-11b4-4b57-9ac0-b1af2401e385 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.790800 Aug 30 14:44:56.394073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 68/123] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:55 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:56.611021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:56.612038 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:56.634158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:56.641643 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:56.642829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.646420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:56.649752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:56.651076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.692148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.715498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-73390985-b8ce-4cf2-9956-735592e86b25 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.511409 Aug 30 14:44:56.717177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 56/124] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:56 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:57.230599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:57.237623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:57.254737 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.256471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.257670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.259725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.260737 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.264620 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.276107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:57.808172 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:57.840927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5eccfb8a-fd74-474d-93b8-e81ee9e69e5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 1.236182 Aug 30 14:44:57.843582 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 69/125] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:56 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:57.851801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:57.853512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:57.865432 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.866200 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.867589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.869055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.870245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.871807 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.016698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.025150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-be3a4bef-9229-481c-a8a4-921845042d8e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.804976 Aug 30 14:44:58.039552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 57/126] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:57 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:58.046568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:58.048102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:58.073891 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.076850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.079086 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.080100 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.090438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.093224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.257534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.285698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.291238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.295058 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-16113a4f-2ca1-4424-8d51-5b435fd10271 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.448871 Aug 30 14:44:58.296620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 70/127] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:57 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:58.420252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-f16e5d38-007f-418e-b7a2-8eb432f3b322 req-a68a43c9-f83d-42ce-b7da-6ab6d13deba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e6f700-d63f-4672-80f4-1ff6f5d17c85", "tag": "3e9a727d-00f3-4b12-a9e6-544c28dd320e"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:58.459927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f16e5d38-007f-418e-b7a2-8eb432f3b322 req-a68a43c9-f83d-42ce-b7da-6ab6d13deba3 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.462395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f16e5d38-007f-418e-b7a2-8eb432f3b322 req-a68a43c9-f83d-42ce-b7da-6ab6d13deba3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.468636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f16e5d38-007f-418e-b7a2-8eb432f3b322 req-a68a43c9-f83d-42ce-b7da-6ab6d13deba3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.470184 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.487052 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-f16e5d38-007f-418e-b7a2-8eb432f3b322 req-a68a43c9-f83d-42ce-b7da-6ab6d13deba3 service nova] Creating event network-changed:3e9a727d-00f3-4b12-a9e6-544c28dd320e for instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 on hv-cinder-82880 Aug 30 14:44:58.492602 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a5a94106-1d8d-433d-b260-dd0516e2d3d3 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.449858 Aug 30 14:44:58.508777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-f16e5d38-007f-418e-b7a2-8eb432f3b322 req-a68a43c9-f83d-42ce-b7da-6ab6d13deba3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090084 Aug 30 14:44:58.511295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 58/128] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:58 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:58.512708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 71/129] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:44:58.871163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:58.873894 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:58.894253 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.895637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.896722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.898576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.899617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.902295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.048351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:59.049910 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:59.066506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.067317 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.067959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.075411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.076250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.076998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.082105 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:59.368332 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.396935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ebfa1089-b05f-4811-8f4e-4917ab0b96a3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.535186 Aug 30 14:44:59.399497 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 59/130] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:58 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:59.416322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:59.424264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:59.426547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.432310 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.432845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.433220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.433974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.434419 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.434831 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.443314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a77589c1-cbf1-485c-af4f-c840f13717f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.399863 Aug 30 14:44:59.444940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 72/131] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:59 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:59.527418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:59.528977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:59.543007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.543546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.543818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.544556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.545102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.548342 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.823660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.839343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.842122 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.844056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-09a0ad09-a133-41c2-b20e-c33b221a15fe tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.440387 Aug 30 14:44:59.845044 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 60/132] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:59 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:59.880638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.890454 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-68934332-df8b-4fe9-8987-ece115b6541e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.373419 Aug 30 14:44:59.891039 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 73/133] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:59 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:00.424093 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:00.424673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:00.445602 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.446087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.446594 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.451343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.451343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.451343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.493601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:00.494962 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:00.510859 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.512055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.512749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.514824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.515598 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.516333 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.019970 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.035876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8fab0a14-d4b9-490a-824c-5371bf8a7fe2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.616180 Aug 30 14:45:01.042755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 61/134] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:00 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:01.069343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:01.071107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:01.105293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.108068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.111514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.112109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.113031 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.113905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.114673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.124451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6fe08786-5226-454a-baec-644fe91aa001 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.643018 Aug 30 14:45:01.130769 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 74/135] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:00 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:01.137785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:01.138487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:01.146332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.160306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.161165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.161950 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.162429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.162851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.680508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.712991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.719168 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.725526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2e90f49e-d339-4bd5-9379-fe449e8a9b01 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.681039 Aug 30 14:45:01.739326 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 62/136] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:01 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:01.793658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.813036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-29a7eec8-53f1-4533-a9e1-4e5019bbf576 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.680495 Aug 30 14:45:01.828079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 75/137] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:01 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:02.067589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:02.068632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:02.084173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.084807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.085566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.086413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.087007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.087457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.171015 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:02.172465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:02.206364 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.211298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.211298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.211298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.213064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.213994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.545273 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:02.562735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-989f0d0c-d9dd-4683-98d1-b43fa0315ced tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.498535 Aug 30 14:45:02.568298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 63/138] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:02 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:02.626326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:02.638040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f5fa572f-f81e-4ebb-ba2e-fb73dad0017d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.474209 Aug 30 14:45:02.640234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 76/139] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:02 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:02.784174 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:02.785650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:02.795343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.796198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.797234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.798250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.798704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.799110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.858071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:02.859103 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:02.885675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.887736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.888524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.889748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.890546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.891494 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.237904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.284520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.291991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.294327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6f38cae2-f9fb-47e2-9b78-435fa3298aa1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.518129 Aug 30 14:45:03.298999 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 64/140] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:02 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:03.500734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.515556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-96b754c0-915b-49cb-b8dc-eca630be217e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.661913 Aug 30 14:45:03.517422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 77/141] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:02 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:03.603806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:03.604949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:03.632941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.634011 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.634793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.636181 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.640053 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.641137 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.672332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:03.681070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:03.722013 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.734734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.734734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.734734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.734734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.735347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.590704 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:04.604365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-22af2b5d-9677-4a06-a0eb-50fe9f955f93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.941066 Aug 30 14:45:04.608014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 78/142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:03 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:04.634371 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:04.635831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:04.643388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.644160 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.644732 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.645685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.646385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.647691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.742368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:04.762360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ead48d37-8958-44e2-8ad4-43a0a22be56b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 1.173890 Aug 30 14:45:04.763884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 65/143] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:03 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:04.794761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:04.797246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:04.818872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.819729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.820971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.823157 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.824629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.825704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.053004 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.074722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.079400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.082779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-98d0f3c0-9621-40a6-b5a8-21963c88c1c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.472702 Aug 30 14:45:05.084305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 79/144] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:04 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:05.185692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.202813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9fa7e2cd-938b-4cbd-b853-97bbb590fdb5 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.435619 Aug 30 14:45:05.207307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 66/145] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:04 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:05.256232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-49e327ca-3ce8-4a02-9d1e-dc3cd01cdab8 req-092cdc7d-3e1c-43f1-a76c-a14fa5615de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5ebea7-409d-4e00-9a26-030000cdb28b", "name": "network-vif-plugged", "status": "completed", "tag": "e3436675-e20f-493c-ac9e-bc8835e548ed"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:05.297131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-49e327ca-3ce8-4a02-9d1e-dc3cd01cdab8 req-092cdc7d-3e1c-43f1-a76c-a14fa5615de3 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.298104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-49e327ca-3ce8-4a02-9d1e-dc3cd01cdab8 req-092cdc7d-3e1c-43f1-a76c-a14fa5615de3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.298743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-49e327ca-3ce8-4a02-9d1e-dc3cd01cdab8 req-092cdc7d-3e1c-43f1-a76c-a14fa5615de3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.373133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-49e327ca-3ce8-4a02-9d1e-dc3cd01cdab8 req-092cdc7d-3e1c-43f1-a76c-a14fa5615de3 service nova] Creating event network-vif-plugged:e3436675-e20f-493c-ac9e-bc8835e548ed for instance ec5ebea7-409d-4e00-9a26-030000cdb28b on hv-cinder-82880 Aug 30 14:45:05.383416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-49e327ca-3ce8-4a02-9d1e-dc3cd01cdab8 req-092cdc7d-3e1c-43f1-a76c-a14fa5615de3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296701 Aug 30 14:45:05.387641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 80/146] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:05.644424 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:05.645433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.655360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.656068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.656829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.658568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.660577 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.661722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.799754 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:05.800536 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.818187 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.819031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.821214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.825538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.827064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.827706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.856575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.866802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-be694527-bca5-4325-89a3-17032ee61737 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.241627 Aug 30 14:45:05.876958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 67/147] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:05 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:06.070724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.081486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-71e28afa-5774-4870-b3c9-20ecd6921035 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.287584 Aug 30 14:45:06.082512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 81/148] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:05 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:06.108147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:06.109120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:06.117496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.118362 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.119063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.120014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.121165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.121794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.236853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:06.239512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:06.280506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.283123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.285075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.286742 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.287560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.288577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.530579 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.593650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.598798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.604822 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d33cc861-58da-4c66-bfa1-adf0ab79a490 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.500761 Aug 30 14:45:06.606262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 68/149] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:06 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:06.718629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.735841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bf88fae3-e368-4c84-998e-308b2d9a567a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.513039 Aug 30 14:45:06.751012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 82/150] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:06 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:06.895793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:06.898036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:06.906572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.907561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.908637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.909880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.910554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.911227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.108366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:07.109295 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:07.137745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.139006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.140082 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.141144 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.141707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.142226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.148455 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:07.159138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-47be76f7-18b3-4eef-befd-8fe0928d983a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.268212 Aug 30 14:45:07.159725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 69/151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:06 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:07.372960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:07.385055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-31b99638-acca-4736-84b1-103b9a240db0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.281293 Aug 30 14:45:07.386087 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 83/152] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:07 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:07.412261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-27815a41-7fc5-4781-95f1-8188b0bbf501 req-32fa673e-21e4-42b7-ba0d-46912bad6422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1622c2-5c2a-4656-b39c-0f2f520fcf52", "name": "network-vif-plugged", "status": "completed", "tag": "cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:07.424224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-27815a41-7fc5-4781-95f1-8188b0bbf501 req-32fa673e-21e4-42b7-ba0d-46912bad6422 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.424709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-27815a41-7fc5-4781-95f1-8188b0bbf501 req-32fa673e-21e4-42b7-ba0d-46912bad6422 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.425136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-27815a41-7fc5-4781-95f1-8188b0bbf501 req-32fa673e-21e4-42b7-ba0d-46912bad6422 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.439259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-27815a41-7fc5-4781-95f1-8188b0bbf501 req-32fa673e-21e4-42b7-ba0d-46912bad6422 service nova] Creating event network-vif-plugged:cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1 for instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 on hv-cinder-82880 Aug 30 14:45:07.445689 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-27815a41-7fc5-4781-95f1-8188b0bbf501 req-32fa673e-21e4-42b7-ba0d-46912bad6422 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037327 Aug 30 14:45:07.446662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 70/153] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:07.642354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:07.643932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:07.656331 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.657061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.658070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.659606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.660828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.661678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.765369 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:07.768535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:07.791991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.795897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.797573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.798994 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.801490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.804290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.151230 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.169213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.171259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.172766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c646eff6-efa5-474b-b0e7-9599ed8e1aa3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.547553 Aug 30 14:45:08.173566 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 84/154] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:07 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:08.197048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:08.197669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:08.208836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.214852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.215356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.215793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.219396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.220435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.221065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.227775 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b3e16ce6-bcab-4195-b81e-7adcd87bd51f tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.472410 Aug 30 14:45:08.229256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 71/155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:07 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:08.421379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:08.422931 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:08.439878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.443329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.444689 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.453041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.456682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.458130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.505349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.508432 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-79ee4b7a-bb88-424a-bc3b-d3ff60e06cbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.315916 Aug 30 14:45:08.509678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 85/156] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:08 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:08.797905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.836756 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b21393c3-5bfe-43fd-b217-a84c6616d29b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.426734 Aug 30 14:45:08.838102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 72/157] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:08 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:09.198171 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:09.199429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:09.208050 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=67 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:09.210081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.212255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.213068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.214498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.215132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.215971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.274801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:09.275669 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:09.291390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.297049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.298126 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.298972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.300696 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.301215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.639227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.664718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-07db3b71-ec3e-4986-9993-5693a4cbdd88 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.393753 Aug 30 14:45:09.678725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 73/158] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:09 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:09.695575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:09.696804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:09.698680 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.709245 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.710177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.710835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.711797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.712494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.713121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.716957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.725858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.736151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f2d1db39-3bf5-495c-b964-69f7cda49767 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.539276 Aug 30 14:45:09.740323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 86/159] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:09 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:09.774932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:09.860638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:09.863716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:09.880638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.882219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.884880 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.888722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.891298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.893365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.720487 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:10.746309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-07d895ca-e08b-49e4-8a8e-63d149f7a0b0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 1.066005 Aug 30 14:45:10.747319 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 74/160] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:09 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:10.760362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:10.765214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e2c00e9c-39d2-48bd-9050-7821d2986709 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.909976 Aug 30 14:45:10.776352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:10.777167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 87/161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:09 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:10.778165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:10.783266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:10.789256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.790610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.791726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.793305 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.794478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.795485 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.800486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:10.826383 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.827600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.829417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.831907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.839682 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.840899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.297387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.323490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6924b056-9f9a-4484-a780-f45dfe8a376a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.560752 Aug 30 14:45:11.324825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 75/162] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:10 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:11.325761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.344141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-24393934-4760-4f07-a1c5-ecc422714b1b req-0a2e2c89-77d4-4b85-836d-8ab839992caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df889ee2-48d9-4b45-b6a3-64e3dc785b20", "name": "network-vif-plugged", "status": "completed", "tag": "48041a61-1681-47c7-a171-bba3d49197a2"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:11.345825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.347424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.348709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-126c6dc5-4b45-4e52-aec2-1ab2d79ec18b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.569876 Aug 30 14:45:11.362404 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-24393934-4760-4f07-a1c5-ecc422714b1b req-0a2e2c89-77d4-4b85-836d-8ab839992caa service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.363513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-24393934-4760-4f07-a1c5-ecc422714b1b req-0a2e2c89-77d4-4b85-836d-8ab839992caa service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.364499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 88/163] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:10 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:11.364816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-24393934-4760-4f07-a1c5-ecc422714b1b req-0a2e2c89-77d4-4b85-836d-8ab839992caa service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.385951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-24393934-4760-4f07-a1c5-ecc422714b1b req-0a2e2c89-77d4-4b85-836d-8ab839992caa service nova] Creating event network-vif-plugged:48041a61-1681-47c7-a171-bba3d49197a2 for instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 on hv-cinder-82880 Aug 30 14:45:11.394275 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-24393934-4760-4f07-a1c5-ecc422714b1b req-0a2e2c89-77d4-4b85-836d-8ab839992caa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064996 Aug 30 14:45:11.400167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 76/164] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:11.780803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:11.782469 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:11.791060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.791885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.794433 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.796288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.797613 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.798281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.799779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:11.801090 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:11.814674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.815168 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.815594 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.816322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.816764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.817176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.830599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:12.194792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.211031 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.224365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-037a9ddc-b071-4e77-ac96-891750e1892c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.446856 Aug 30 14:45:12.225608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-32af7aac-ebde-4fc5-8aa9-cccc33e98590 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.430034 Aug 30 14:45:12.226478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 77/165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:11 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:12.240124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 89/166] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:11 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:12.351885 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:12.355888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:12.366709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.367238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.373112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.373637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:12.374096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.374582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.375017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.375430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:12.383406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.384025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.384569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.385372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.385883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.386409 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.613714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.631431 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.635614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.636747 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8ca556fa-940e-4a9e-be08-128e10c73ccb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.267889 Aug 30 14:45:12.637314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 90/167] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:12 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:12.670300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.685998 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c1d32d40-12d6-478c-8050-c3548405132c tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.343869 Aug 30 14:45:12.687343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 78/168] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:12 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:13.255604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:13.257734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:13.262599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:13.264484 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:13.271408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.272250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.273153 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.274341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.275096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.275987 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.276524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.300931 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.301374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.301948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.305507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.306176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.649767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:13.668350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bba72515-e496-4347-8507-5e66895a2ee9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.422190 Aug 30 14:45:13.671636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 91/169] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:13 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:13.676895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:13.680770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:13.692887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-748b1651-a831-4402-bdf5-e6a81d1b393b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.434855 Aug 30 14:45:13.693294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 79/170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:13 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:13.704499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:13.721515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:13.722159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:13.722538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.723650 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.725987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.726930 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.729658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.730242 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.739678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.740213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.740661 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.741375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.741821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.742233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.055407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.056522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.077577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.079098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.079983 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bdee753a-de20-4045-bdf7-c129e0443b77 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.374131 Aug 30 14:45:14.080849 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 80/171] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:13 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:14.082432 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-99ee73ea-5468-4c2f-b30f-6a96c8c56af3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.409390 Aug 30 14:45:14.082999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 92/172] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:13 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:14.706156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:14.707665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:14.720066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:14.721390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:14.728557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=77 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.730736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.733601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.734481 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.735157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.736327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.737350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.738075 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.739037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.739779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.740484 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.741251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.743769 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.118218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.151584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3a741d76-429b-4ee8-8e4a-0c4a11aa590c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.449386 Aug 30 14:45:15.152673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 81/173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:14 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:15.158059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.161546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:15.162529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:15.172877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.174012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.174956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.176360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.177343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.178238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.179347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9a3a51a5-76f8-4773-887c-07d2532a9114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.464165 Aug 30 14:45:15.180913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 93/174] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:14 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:15.187565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:15.189177 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:15.197189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.200076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.201145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.202421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.203180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.203793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.571403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.578151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.592670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4f981883-f864-419b-bb63-8725cb374d8a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.437849 Aug 30 14:45:15.595576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 82/175] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:15 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:15.599429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.602366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.604783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-211cb6e6-41a4-418b-a705-37cc564632f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.421861 Aug 30 14:45:15.606525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 94/176] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:15 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:16.202693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:16.203963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:16.214088 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.216680 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.217309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.221010 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.224242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.224750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.226896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:16.228489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:16.270143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.271810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.275551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.278604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.285244 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.287068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.720659 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:16.746112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-75df70fb-bcaf-4987-8b4d-a72d5bf70e1d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.547892 Aug 30 14:45:16.749825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 83/177] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:16.776905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:16.778723 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:16.807224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.809592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.811949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.813082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.814658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.816823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.821545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:16.861360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9433fc88-81fb-49b9-a796-cc0e7cd64b57 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.644537 Aug 30 14:45:16.862588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 95/178] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:16.867896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:16.869240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:16.876898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.878024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.878981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.879942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.880700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.881345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.494452 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.517334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f555d663-c581-4c85-bbc0-a50a251e53f7 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.759462 Aug 30 14:45:17.517936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 84/179] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:17.528228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.560823 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.564223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.566385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-edda733c-c6e8-4cf1-a091-3d596002702b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.702232 Aug 30 14:45:17.592820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 96/180] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:17.773704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:17.774918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:17.782327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.783596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.784142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.785528 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.786286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.786870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.887905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:17.910071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:17.943628 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.945812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.947412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.948766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.949745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.950891 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.021198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.041953 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cc274f95-95dc-4e9c-810a-61ab29cec5c7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.271978 Aug 30 14:45:18.042826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 85/181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:17 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:18.303082 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.319244 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ef846a9f-3806-4bf5-b237-016cd953a7c4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.437432 Aug 30 14:45:18.321115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 97/182] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:17 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:18.345108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-c9a2e059-b7e6-433c-b30d-04c8b2afbae8 req-d6a7cb59-c0ad-4454-8603-07b5e0fd6df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7370a3a-e107-40f2-b532-5bc089b157e8", "name": "network-vif-plugged", "status": "completed", "tag": "0c6380b4-099c-44ab-8d72-4d08a77e7849"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:18.366549 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c9a2e059-b7e6-433c-b30d-04c8b2afbae8 req-d6a7cb59-c0ad-4454-8603-07b5e0fd6df9 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.367364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c9a2e059-b7e6-433c-b30d-04c8b2afbae8 req-d6a7cb59-c0ad-4454-8603-07b5e0fd6df9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.367985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c9a2e059-b7e6-433c-b30d-04c8b2afbae8 req-d6a7cb59-c0ad-4454-8603-07b5e0fd6df9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.389046 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-c9a2e059-b7e6-433c-b30d-04c8b2afbae8 req-d6a7cb59-c0ad-4454-8603-07b5e0fd6df9 service nova] Creating event network-vif-plugged:0c6380b4-099c-44ab-8d72-4d08a77e7849 for instance c7370a3a-e107-40f2-b532-5bc089b157e8 on hv-cinder-82880 Aug 30 14:45:18.403791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-c9a2e059-b7e6-433c-b30d-04c8b2afbae8 req-d6a7cb59-c0ad-4454-8603-07b5e0fd6df9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063122 Aug 30 14:45:18.412480 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 86/183] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:18.557568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:18.557568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:18.567024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.568068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.568854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.570024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.570880 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.571727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.594802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:18.596292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:18.610668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.613555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.614012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.618271 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.619044 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.619673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.960380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.974109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6982abb2-ba50-44e2-92b9-a1f701455cb6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.425308 Aug 30 14:45:18.975154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 98/184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:18 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:19.009081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.036718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.039172 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.041477 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7869fb3e-123a-44b5-a35c-219d355037b5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.452471 Aug 30 14:45:19.042459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 87/185] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:18 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:19.080617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:19.081648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:19.093234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.094384 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.095121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.096284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.097081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.097694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.307527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.325191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-44cce57c-f4df-47bc-abe9-ecbac2e2fcdf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.251932 Aug 30 14:45:19.326710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 99/186] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:19 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:19.360281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:19.360281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:19.365756 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.366247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.366673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.367379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.367835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.368280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.546087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.560055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d2c1354b-b0ac-4168-9c63-873a9558d490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.205219 Aug 30 14:45:19.563582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 88/187] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:19 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:20.005358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:20.008293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:20.024598 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.025017 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.025455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.026185 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.026770 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.027041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.080017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:20.081282 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:20.126261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.126261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.126261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.126261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.126949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.126949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.459529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.477939 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cb545163-93ae-467a-87e2-ec8122fb9ba9 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.482802 Aug 30 14:45:20.501555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 100/188] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:19 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:20.512454 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:20.513713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:20.525519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.526793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.527832 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.529470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.530539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.531590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.593121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.604038 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.605826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.607909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-71e9d2fd-2db6-46f4-b0ef-8d6479556c82 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1406 microversion: 2.20 time: 0.534774 Aug 30 14:45:20.620954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 89/189] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:20 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1406 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:20.637522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:20.639476 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:20.664026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.665005 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.665884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.667024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.667742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.668671 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.860299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.875093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-32a2dccf-cece-4c70-b54c-ce1eeefd03e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.371699 Aug 30 14:45:20.875722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 101/190] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:20 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:20.925365 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.935755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f1a6b2fb-c192-4756-9de7-581dad7db8db tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.312995 Aug 30 14:45:20.936785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 90/191] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:20 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:21.522794 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.523973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.535376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.536390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.537164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.538372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.539191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.539944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.635701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.636843 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.643294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.643879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.644423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.645200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.645743 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.646363 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.791455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:21.805370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ded6a50e-c370-43fc-9e41-88e15e4f2ccb tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.289724 Aug 30 14:45:21.808475 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 102/192] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:21.856341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:21.866237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:21.867735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:21.868982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ef3bea60-00d2-41da-870c-5a4529ff5853 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1597 microversion: 2.20 time: 0.237655 Aug 30 14:45:21.884459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 91/193] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1597 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:21.896761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.896761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.902677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.903360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.904125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.905529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.906307 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.907044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.917708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.921584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.950284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.953481 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.954282 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.956875 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.957645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.958308 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.005266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:22.141779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a1815073-f53a-4c53-afee-8598f3569534 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.252372 Aug 30 14:45:22.142377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 103/194] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-interface => generated 284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:45:22.154462 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:22.155321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:22.162593 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.163465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.164159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.165297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.165990 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.166656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.273377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:22.294145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4d9278fc-77c1-4097-a323-ec789b0b7772 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.388443 Aug 30 14:45:22.295238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 92/195] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:22.455325 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:22.467097 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1d24d30c-38bf-4bad-9129-aff7f3aecf25 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.316547 Aug 30 14:45:22.481924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 104/196] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:22 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:22.833466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:22.834861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:22.845682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.847075 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.847880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.849026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.849668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.850927 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.216639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.243708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-494fa6be-34e9-4d91-841f-4f139c2c6868 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.415525 Aug 30 14:45:23.249428 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 93/197] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:22 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:23.324048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:23.324659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:23.332076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.344485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.346335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.347111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.347586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.348035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.510946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:23.514304 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:23.532975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.534553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.536492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.538560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.539755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.540941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.594758 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.630805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dba78f5b-8cb5-44c0-9c88-6b63b9088a76 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.309103 Aug 30 14:45:23.634789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 105/198] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:23 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:23.777036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.796839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3cf9e4be-c2ca-461c-acf0-f127f8e9b330 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.302628 Aug 30 14:45:23.817645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 94/199] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:23 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:24.118865 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-2ffcfe81-cbf5-42b2-8aac-f9d512eeaf32 req-b6b575a2-534b-492d-93da-70755da2092e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1622c2-5c2a-4656-b39c-0f2f520fcf52", "tag": "cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:24.132267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-2ffcfe81-cbf5-42b2-8aac-f9d512eeaf32 req-b6b575a2-534b-492d-93da-70755da2092e service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.134128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-2ffcfe81-cbf5-42b2-8aac-f9d512eeaf32 req-b6b575a2-534b-492d-93da-70755da2092e service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.134781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-2ffcfe81-cbf5-42b2-8aac-f9d512eeaf32 req-b6b575a2-534b-492d-93da-70755da2092e service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.150726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-2ffcfe81-cbf5-42b2-8aac-f9d512eeaf32 req-b6b575a2-534b-492d-93da-70755da2092e service nova] Creating event network-changed:cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1 for instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 on hv-cinder-82880 Aug 30 14:45:24.156820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-2ffcfe81-cbf5-42b2-8aac-f9d512eeaf32 req-b6b575a2-534b-492d-93da-70755da2092e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043620 Aug 30 14:45:24.158088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 106/200] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:24.272700 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:24.273954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:24.284398 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.285233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.285955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.287379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.288234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.288965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.640962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:24.651447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3753a98b-15d7-4846-a24b-55d831bbbe50 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.385901 Aug 30 14:45:24.657825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 95/201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:24 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:24.662776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:24.665212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:24.677112 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.677821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.678545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.679818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.681075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.681825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.690996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.835793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:24.842390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:24.887635 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.893224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.894553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.898922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.902401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.903842 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.023601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.053487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-82d0eed9-9b6d-42c6-865c-820242931ea3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.398468 Aug 30 14:45:25.055575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 107/202] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:24 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:25.239211 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.258537 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e7c49aee-3fec-4cf7-b5bd-18e5160681cd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.429809 Aug 30 14:45:25.277690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 96/203] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:24 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:25.679507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:25.680596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:25.687887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.688407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.688893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.692212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.692212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.692212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.886256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.895432 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-52111d60-80b3-49fd-a2f2-d17ce1c2dc14 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.219924 Aug 30 14:45:25.896025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 108/204] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:25 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:26.089226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:26.090608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:26.101071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.101702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.102429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.103682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.104820 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.105572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.297704 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:26.299720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:26.312625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.313814 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.315765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.317680 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.318712 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.320313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.387745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:26.404784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2c98085c-6249-4267-b661-0175f0b19639 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.325173 Aug 30 14:45:26.406027 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 97/205] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:26 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:26.482034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-9ed162da-4e13-4426-8f98-daa41b21b879 req-63183377-071f-4825-bc32-634a8ab4c79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e6f700-d63f-4672-80f4-1ff6f5d17c85", "name": "network-vif-plugged", "status": "completed", "tag": "3e9a727d-00f3-4b12-a9e6-544c28dd320e"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:26.500073 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-9ed162da-4e13-4426-8f98-daa41b21b879 req-63183377-071f-4825-bc32-634a8ab4c79a service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.500795 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-9ed162da-4e13-4426-8f98-daa41b21b879 req-63183377-071f-4825-bc32-634a8ab4c79a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.501456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-9ed162da-4e13-4426-8f98-daa41b21b879 req-63183377-071f-4825-bc32-634a8ab4c79a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.526986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-9ed162da-4e13-4426-8f98-daa41b21b879 req-63183377-071f-4825-bc32-634a8ab4c79a service nova] Creating event network-vif-plugged:3e9a727d-00f3-4b12-a9e6-544c28dd320e for instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 on hv-cinder-82880 Aug 30 14:45:26.539545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-9ed162da-4e13-4426-8f98-daa41b21b879 req-63183377-071f-4825-bc32-634a8ab4c79a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070783 Aug 30 14:45:26.542451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 98/206] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:26.574066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:26.595318 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-366904da-a90e-4330-b1fb-1183649e6f88 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.307024 Aug 30 14:45:26.597059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 109/207] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:26 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:26.928083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:26.928817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:26.935550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.936997 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.936997 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.937739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.938159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.938573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.145401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:27.159554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-63cd15e8-bde2-4606-beee-04a6d796dfd6 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1315 microversion: 2.1 time: 0.235770 Aug 30 14:45:27.160890 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 99/208] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:26 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:27.453981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:27.455009 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:27.467663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.469070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.469812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.472157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.473253 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.474045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.641788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:27.643125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:27.658818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.659980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.660567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.661248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.661694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.662097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.736525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:27.748196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6f47ad0d-e96a-4f36-bda8-854e9c6a7d55 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.301765 Aug 30 14:45:27.748971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 110/209] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:27 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:27.876490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:27.885205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-123a8e7c-29a0-4a5b-bb57-76ade01a547b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.253834 Aug 30 14:45:27.885791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 100/210] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:27 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:28.197537 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:28.198376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:28.205229 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.205749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.206162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.206938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.207385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.208223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.478079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:28.507802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-98899ab6-6596-4714-811a-0daac6d180fa tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1500 microversion: 2.1 time: 0.314162 Aug 30 14:45:28.510066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 111/211] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:28 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1500 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:28.770658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:28.771469 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:28.780094 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.780997 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.781678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.782628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.783242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.783872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.918938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:28.920776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:28.938361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.940085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.941122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.943665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.945429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.946385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:29.033417 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:29.049800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-83644e32-ce6e-43bc-8119-26bdffeb5d3c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.283754 Aug 30 14:45:29.050420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 101/212] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:28 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:29.227138 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:29.245170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-72635463-22ae-4c02-9cad-0fc4385e6847 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.340013 Aug 30 14:45:29.265089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 112/213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:28 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:30.078289 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:30.078289 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:30.083067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.083594 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.084092 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.084797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.085237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.085649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.261492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:30.275247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-10860b27-cf40-46cd-ade2-7d2d1661919a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.203319 Aug 30 14:45:30.275861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 102/214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:30 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:30.289400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:30.290416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:30.301315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.301994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.302602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.303733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.304520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.305539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.479780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:30.488275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2aa6658f-826b-4535-b8d8-71f4a31761a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.206755 Aug 30 14:45:30.488872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 113/215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:30 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:31.300333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:31.301306 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:31.312541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.313335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.314062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.315233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.315974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.316708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.497142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:31.506301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-45a7dd5b-584b-4cde-bf01-322dcdf1eab9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.211058 Aug 30 14:45:31.508061 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 103/216] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:31 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:31.521072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:31.521688 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:31.528537 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.529760 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.530205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.530930 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.531386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.531818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.695100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:31.704332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8f2c3499-f890-4ef9-9307-d55f7eeb3e97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.193611 Aug 30 14:45:31.704925 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 114/217] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:31 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:32.531968 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:32.532675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:32.539140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.539621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.540081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.540779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.541227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.541640 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.695492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:32.704456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7b4f85d3-ed07-4bc5-ace6-aac484a0a34a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1322 microversion: 2.1 time: 0.176866 Aug 30 14:45:32.705049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 104/218] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:32 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:32.728587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:32.729664 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:32.740488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.741324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.742071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.742975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.743451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.744114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.949094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:32.959574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f4282028-da33-4c06-87a5-78caefa62b72 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.237647 Aug 30 14:45:32.960343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 115/219] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:32 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:33.731072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:33.732543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:33.744898 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.745909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.746611 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.748198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.749389 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.750237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.936930 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:33.946829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c895c301-ba2b-4547-90b0-4c5b1bad9ca7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1515 microversion: 2.1 time: 0.223252 Aug 30 14:45:33.948608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 105/220] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:33 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:33.978075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:33.983232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:33.984498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:33.988802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:33.997385 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.997903 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.999829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.001273 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.002296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.003150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.015859 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.017023 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.017790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.018843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.019726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.020507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.058937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'flavor' on Instance uuid c7370a3a-e107-40f2-b532-5bc089b157e8 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:45:34.242818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ff16400e-3810-4459-baa4-67d8d6185ced tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8/action" status: 200 len: 32 microversion: 2.1 time: 0.276042 Aug 30 14:45:34.244039 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 116/221] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:45:33 2022] POST /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:45:34.258169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:34.259276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:34.269923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.277361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.278713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.280711 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.282098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.282934 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.688206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:34.700306 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-18825b1f-83bf-4cd9-a339-af6a40c558e8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.720887 Aug 30 14:45:34.701771 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 106/222] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:33 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:34.734150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:34.743601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4728f3a4-91ec-478f-a947-b60502e1449b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.491076 Aug 30 14:45:34.744215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 117/223] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:34 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:35.627103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd4278f1-39a7-414d-9f45-c8d304541901"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:35.630097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:35.637847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.638802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.639231 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:35.640327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.641006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.641428 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:35.725545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:35.726988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:35.755884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.758526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.760168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:35.763210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.768939 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.770886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.000314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:36.008792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d786f692-b3f3-4072-8b87-a3009a36dca8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1362 microversion: 2.1 time: 0.290038 Aug 30 14:45:36.009594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 118/224] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:35 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:36.015051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:36.016154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:36.023939 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.024762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.025383 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.026311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.026974 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.027765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.467733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:36.498340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-586f4e5a-92f6-47a2-a293-5e2be1080e39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.487255 Aug 30 14:45:36.512053 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 119/225] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:36 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:36.541388 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-35b34b47-3a01-45cf-932f-8f7f5a5261d2 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "POST /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918123 Aug 30 14:45:36.548051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 107/226] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:45:35 2022] POST /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20/os-volume_attachments => generated 194 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:37.045572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:37.048738 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:37.065559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.066450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.067440 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.069010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.070598 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.073048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.340661 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:37.353991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dddeac0a-ae84-463a-aaca-aefa53c2c713 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1548 microversion: 2.1 time: 0.318705 Aug 30 14:45:37.355357 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 120/227] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:37 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1548 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:37.397748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:37.398663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:37.407457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.408322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.408906 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.409765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.410280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.411283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.441986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:37.538766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:37.539570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:37.549904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.552179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.553125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.556914 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.557908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.558566 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.729716 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f0de0088-aaad-4e10-b723-5d2f979235b3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.336909 Aug 30 14:45:37.730401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 108/228] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:45:37 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-interface => generated 284 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:38.028377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:38.037606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:38.066707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d206076-d51b-4d13-be6a-3d12b16ab054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.532999 Aug 30 14:45:38.068869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 121/229] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:37 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:39.088834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:39.089510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:39.096360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:39.097110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:39.097718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:39.098775 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:39.099369 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:39.099765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:39.256765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:39.265966 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2d817094-7400-4afb-9ac3-c411db86ab80 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.180858 Aug 30 14:45:39.266488 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 109/230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:39 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:39.416030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-d9529de8-00e8-48d5-bde6-939cca6fc6e5 req-6cdb04cc-cc13-4b83-a6d2-09b9c8d75448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e6f700-d63f-4672-80f4-1ff6f5d17c85", "tag": "3e9a727d-00f3-4b12-a9e6-544c28dd320e"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:39.422236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=72 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:39.428568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d9529de8-00e8-48d5-bde6-939cca6fc6e5 req-6cdb04cc-cc13-4b83-a6d2-09b9c8d75448 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:39.429015 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d9529de8-00e8-48d5-bde6-939cca6fc6e5 req-6cdb04cc-cc13-4b83-a6d2-09b9c8d75448 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:39.429803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d9529de8-00e8-48d5-bde6-939cca6fc6e5 req-6cdb04cc-cc13-4b83-a6d2-09b9c8d75448 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:39.445945 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-d9529de8-00e8-48d5-bde6-939cca6fc6e5 req-6cdb04cc-cc13-4b83-a6d2-09b9c8d75448 service nova] Creating event network-changed:3e9a727d-00f3-4b12-a9e6-544c28dd320e for instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 on hv-cinder-82880 Aug 30 14:45:39.452643 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-d9529de8-00e8-48d5-bde6-939cca6fc6e5 req-6cdb04cc-cc13-4b83-a6d2-09b9c8d75448 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041074 Aug 30 14:45:39.453358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 122/231] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:40.291236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:40.293078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:40.311318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.312046 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.312779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.313529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.313980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.314804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.593148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:40.608344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e2b907f1-8978-4f2d-a82b-3419ab55d1e8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.323338 Aug 30 14:45:40.608928 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 110/232] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:40 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:41.630622 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:41.631295 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:41.637999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.638457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.638883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.639567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.640041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.640455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.798507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:41.808617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-31e1a82f-68e2-4dba-89ab-51c4be982c42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.182111 Aug 30 14:45:41.809251 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 123/233] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:41 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:42.830958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:42.831897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:42.838823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.839313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.839737 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.840490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.841453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.841884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.991153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:42.999569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8ec13f85-aae0-4cf5-9f15-07f9704c5133 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.172556 Aug 30 14:45:43.000298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 111/234] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:42 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:44.037567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:44.038164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:44.046782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.047353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.047896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.049032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.049544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.050151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.210858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:44.219499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2c2fd815-c76a-4591-82d6-71cd88a68d88 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.187639 Aug 30 14:45:44.220116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 124/235] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:44 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:45.244213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:45.244969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:45.248068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=62 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:45.254023 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:45.254482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:45.254920 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:45.255946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:45.256420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:45.256825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:45.423490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:45.432961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b5b291e3-f4eb-4a53-b90e-981e91cf21f7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.193664 Aug 30 14:45:45.433390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 112/236] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:45 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:46.455266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:46.456100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:46.462398 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:46.462890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:46.463319 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:46.464099 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:46.464556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:46.464997 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:46.672600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:46.681988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f899d90f-0826-4ba9-8853-fe121032301d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.230585 Aug 30 14:45:46.682583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 125/237] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:46 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:47.705317 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:47.706231 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:47.713586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:47.714086 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:47.719530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:47.719530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:47.719530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:47.719530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:47.887670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:47.895959 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-edff6f77-6567-4c07-81e6-56986ab64904 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.195634 Aug 30 14:45:47.896571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 113/238] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:47 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:48.923494 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:48.924235 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:48.930866 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:48.931447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:48.931940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:48.932804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:48.933385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:48.933872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:49.082678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:49.092586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cfefb127-cdc3-4b2d-bb0b-d3ae8e8665e6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.173188 Aug 30 14:45:49.098701 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 126/239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:48 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:50.113892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:50.114503 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:50.121832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:50.122269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:50.122710 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:50.123438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:50.123885 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:50.124401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:50.276998 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:50.288823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e6f9114e-3a23-4609-92b3-c49bf8161335 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.178663 Aug 30 14:45:50.289554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 114/240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:50 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:51.314113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:51.315154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:51.323625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:51.324142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:51.324575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:51.325463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:51.326196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:51.326366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:51.483915 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:51.492756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-25dedd20-4704-438f-a4eb-9cff87f84755 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.185354 Aug 30 14:45:51.493479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 127/241] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:51 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:52.515147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:52.515874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:52.523886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:52.526622 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:52.527111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:52.527876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:52.528513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:52.528956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:52.686876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:52.695231 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cf7fd999-d296-4530-97d6-7840684d9384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.184772 Aug 30 14:45:52.695821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 115/242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:52 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:53.726881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:53.727482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:53.734834 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:53.735326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:53.735757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:53.736499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:53.736942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:53.737358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:53.901223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:53.910618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-94ceb201-102a-41d1-bde9-1a525f7d8cd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.189028 Aug 30 14:45:53.911327 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 128/243] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:53 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:54.934600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:54.935396 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:54.943102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:54.943624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:54.944080 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:54.944816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:54.945269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:54.945667 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:55.090887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:55.105021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fad3752e-aef5-469c-a208-a3911fc40d8a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.174101 Aug 30 14:45:55.106102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 116/244] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:54 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:56.133906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:56.134712 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:56.145050 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.145896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.146667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.147943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.148802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.149570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.337164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:56.347518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c86287c0-14ec-490b-b9d0-1cd79493b55e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.219590 Aug 30 14:45:56.348130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 129/245] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:56 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:57.377293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:57.377999 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:57.386097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:57.386639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:57.387131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:57.388687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:57.389339 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:57.389892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:57.571591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:57.593235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-57397d88-eb26-41b4-8e6c-e10ab9956ebe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.223058 Aug 30 14:45:57.594290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 117/246] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:57 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:58.615617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:58.616273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:58.622692 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:58.623543 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:58.624177 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:58.624900 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:58.625349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:58.625902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:58.808525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:58.824595 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-eb7e25be-8a26-4752-9e7b-e2dd927aa179 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.212801 Aug 30 14:45:58.826645 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 130/247] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:58 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:59.847793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:59.848403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:59.855616 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:59.856294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:59.857482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:59.857659 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:59.858103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:59.858526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.004126 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:00.013084 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-798412dc-62ea-400d-8440-02b7bd3c501d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.168700 Aug 30 14:46:00.013673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 118/248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:59 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:01.034959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:01.035845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:01.042778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:01.043269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:01.043863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:01.044814 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:01.045264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:01.045679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:01.205324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:01.216371 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-99e3a3f7-faa1-430e-9bb2-7de3f64b79dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.185585 Aug 30 14:46:01.216944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 131/249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:01 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:02.242933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:02.244066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:02.255263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:02.255928 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:02.256786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:02.257662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:02.258242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:02.258660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:02.507232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:02.521393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f9f98a8f-6c22-42ac-8ef0-dc5b96b38de8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.285541 Aug 30 14:46:02.522181 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 119/250] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:02 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:02.906918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:02.907795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:02.915180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:02.915937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:02.916456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:02.917183 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:02.917636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:02.918083 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:02.954144 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:46:03.065231 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c5f01752-cf25-4a91-b13a-86a6d1a47b22 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 204 len: 0 microversion: 2.1 time: 0.162263 Aug 30 14:46:03.066016 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 132/251] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:46:02 2022] DELETE /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:46:03.075014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:03.075367 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:03.082813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:03.083346 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:03.083776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:03.084575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:03.085150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:03.085568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:03.243076 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:03.255224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-71d874de-dcad-46f6-a158-4391fc046625 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1552 microversion: 2.1 time: 0.183416 Aug 30 14:46:03.255929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 120/252] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:03 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:03.546377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:03.547062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:03.555646 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:03.556231 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:03.556671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:03.557418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:03.557870 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:03.558285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:03.745878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:03.756831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2b5e9de8-58ef-4e11-8647-cb90cc230e42 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.214862 Aug 30 14:46:03.757947 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 133/253] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:03 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:04.278196 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:04.279106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:04.286237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:04.286720 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:04.287140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:04.287861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:04.288345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:04.288761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:04.493907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:04.504655 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5c8e5d2c-d0fc-49fd-b6b0-32688abd8915 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1552 microversion: 2.1 time: 0.230521 Aug 30 14:46:04.505256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 121/254] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:04 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1552 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:04.783315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:04.784583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:04.801193 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:04.802059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:04.802788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:04.804093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:04.804968 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:04.805834 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:05.025076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:05.033669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-327aa07c-1f96-4d66-86e9-c7b853537e60 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.257508 Aug 30 14:46:05.034278 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 134/255] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:04 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:05.526239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:05.526907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:05.534949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:05.535416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:05.535849 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:05.536645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:05.537098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:05.537517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:05.698559 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:05.711856 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-dd172539-8b91-4bbc-a95b-c9fd9ed58039 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1552 microversion: 2.1 time: 0.189312 Aug 30 14:46:05.712990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 122/256] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:05 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:06.064489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:06.064489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:06.064489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:06.065389 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:06.065389 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:06.066002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:06.066138 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:06.066579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:06.230689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:06.240266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-73694ab1-5a6c-45e4-825d-1d5e762e05ec tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.188623 Aug 30 14:46:06.240871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 135/257] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:06 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:06.742263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:06.743207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:06.755513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:06.756364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:06.757113 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:06.758429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:06.759777 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:06.760717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:07.264412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:07.272960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:07.284609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:07.285383 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:07.285893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:07.286628 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:07.287089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:07.287512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:07.554505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:07.557615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=89 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:07.567907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ede6ffd1-c47f-4952-ae36-1e6445705a93 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1552 microversion: 2.1 time: 0.833752 Aug 30 14:46:07.569040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 123/258] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:06 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1552 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:07.828239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:07.842090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d6f0b1d1-fd1a-470a-8f92-7a42af56ba38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.582285 Aug 30 14:46:07.843184 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 136/259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:07 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:08.598296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:08.600624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:08.626927 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:08.627708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:08.628390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:08.629281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:08.629873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:08.630431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:08.634968 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-ea5955b1-acd7-4f2f-a671-924ad5e095c5 req-23ec1394-b578-4a43-9173-d9bc0bc86ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df889ee2-48d9-4b45-b6a3-64e3dc785b20", "name": "network-vif-deleted", "tag": "48041a61-1681-47c7-a171-bba3d49197a2"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:08.674002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ea5955b1-acd7-4f2f-a671-924ad5e095c5 req-23ec1394-b578-4a43-9173-d9bc0bc86ccc service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:08.675123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ea5955b1-acd7-4f2f-a671-924ad5e095c5 req-23ec1394-b578-4a43-9173-d9bc0bc86ccc service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:08.676419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ea5955b1-acd7-4f2f-a671-924ad5e095c5 req-23ec1394-b578-4a43-9173-d9bc0bc86ccc service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:08.709176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:08.737567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-61002de5-f737-45f1-972c-e4f98b5cbd8e tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1510 microversion: 2.1 time: 0.147348 Aug 30 14:46:08.739766 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 124/260] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:08 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:08.740489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-ea5955b1-acd7-4f2f-a671-924ad5e095c5 req-23ec1394-b578-4a43-9173-d9bc0bc86ccc service nova] Creating event network-vif-deleted:48041a61-1681-47c7-a171-bba3d49197a2 for instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 on hv-cinder-82880 Aug 30 14:46:08.748766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-ea5955b1-acd7-4f2f-a671-924ad5e095c5 req-23ec1394-b578-4a43-9173-d9bc0bc86ccc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121163 Aug 30 14:46:08.757153 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 137/261] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:08.867390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:08.868133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:08.875125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:08.875811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:08.876549 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:08.877464 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:08.878016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:08.878526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:09.042410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:09.058151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-445722d2-0d15-4e81-b8c0-2b496f687a71 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.193947 Aug 30 14:46:09.059808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 125/262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:08 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:09.779202 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:09.780574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:09.784651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:09.788950 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:09.789437 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:09.790074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:09.790789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:09.791311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:09.791752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:09.795700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:09.871696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:09.883227 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-736741e7-cdf6-4a24-96a8-2231a66f8251 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1346 microversion: 2.1 time: 0.112116 Aug 30 14:46:09.896031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 138/263] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:09 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:10.082735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:10.083573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:10.096138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:10.096138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:10.096138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:10.096138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:10.096727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:10.096727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:10.342830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:10.358234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ce5ecb5e-164b-41ae-a529-892468cb861b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.278717 Aug 30 14:46:10.359279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 126/264] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:10 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:10.931017 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:10.934010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:10.949843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:10.950765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:10.951629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:10.955335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:10.956592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:10.957347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:11.039633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:11.040779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:11.041802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:11.042828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lazy-loading 'fault' on Instance uuid df889ee2-48d9-4b45-b6a3-64e3dc785b20 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:46:11.133633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee02494e189d4823ab776ea3da9fd2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7914879d13ad4a589f93b0ce22538d06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:11.153051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bc6484a1-f5cb-4131-852e-744716b6e999 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 200 len: 1305 microversion: 2.1 time: 0.237902 Aug 30 14:46:11.154952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 139/265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:10 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 1305 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:11.392963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:11.393735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:11.401334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:11.401854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:11.402826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:11.415331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:11.415331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:11.415331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:11.619439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:11.628056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-733eb2ce-6ccc-4499-88c6-8494832ab5b1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.239514 Aug 30 14:46:11.629059 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 127/266] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:11 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:12.177763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:12.178411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:12.188496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:12.189009 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:12.189458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:12.190249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:12.190708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:12.191131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:12.357800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] HTTP exception thrown: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Request method failure captured: Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 HTTP/1.1 Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJGs_VtYQUbs4GjdgWS7HQquXwTdbxEmgzSYG4oP92lSc-nv3vLmo7LlKmCgKLLcIdPb54lzNgSJatikPUa_jbPOrdhQjKoys-l6TP9gnUAI8uCDkdzAzQ8o70JMnVihMJBOaLK0dT3wUSDVl03j8U3JPSp0ws8lvUNhZChbxeqv0g Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:46:12.371615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7914879d13ad4a589f93b0ce22538d06", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: ee02494e189d4823ab776ea3da9fd2ee Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.376481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'df889ee2-48d9-4b45-b6a3-64e3dc785b20'} Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:46:12.380122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.383864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.387633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Returning 404 to user: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:46:12.387633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-95a81dcb-1eb0-4df7-8879-2b2a6ad5321a tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 404 len: 111 microversion: 2.1 time: 0.199868 Aug 30 14:46:12.387633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 140/267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:12 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:46:12.524711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:12.529907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:12.538608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:12.539123 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:12.539870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:12.540943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:12.542460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:12.542460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:12.571574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] HTTP exception thrown: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Request method failure captured: Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20/os-volume_attachments HTTP/1.1 Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJGs_VtYQUbs4GjdgWS7HQquXwTdbxEmgzSYG4oP92lSc-nv3vLmo7LlKmCgKLLcIdPb54lzNgSJatikPUa_jbPOrdhQjKoys-l6TP9gnUAI8uCDkdzAzQ8o70JMnVihMJBOaLK0dT3wUSDVl03j8U3JPSp0ws8lvUNhZChbxeqv0g Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:46:12.578850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7914879d13ad4a589f93b0ce22538d06", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: ee02494e189d4823ab776ea3da9fd2ee Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.580189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'server_id': 'df889ee2-48d9-4b45-b6a3-64e3dc785b20'} Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:46:12.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:12.582557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:46:12.583666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Returning 404 to user: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:46:12.583666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-86deb95a-0956-47a5-b8b1-067ef392e938 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065881 Aug 30 14:46:12.585219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 128/268] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:46:12 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:46:12.653679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:12.655563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:12.702800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:12.703634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:12.704441 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:12.705641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:12.706439 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:12.707207 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:12.916196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:12.931985 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fbd4f9aa-73af-4c06-ae54-c1ba48aa462c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.285207 Aug 30 14:46:12.933011 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 141/269] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:12 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:13.725577 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1447280546", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:13.786966 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] validate_networks() for None {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:46:13.873932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:13.874809 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:13.881763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:13.882271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:13.882973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:13.883756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:13.884254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:13.884727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:13.901392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] HTTP exception thrown: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Request method failure captured: Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 HTTP/1.1 Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJGs_VtYQUbs4GjdgWS7HQquXwTdbxEmgzSYG4oP92lSc-nv3vLmo7LlKmCgKLLcIdPb54lzNgSJatikPUa_jbPOrdhQjKoys-l6TP9gnUAI8uCDkdzAzQ8o70JMnVihMJBOaLK0dT3wUSDVl03j8U3JPSp0ws8lvUNhZChbxeqv0g Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:46:13.903959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7914879d13ad4a589f93b0ce22538d06", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: ee02494e189d4823ab776ea3da9fd2ee Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.906560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'df889ee2-48d9-4b45-b6a3-64e3dc785b20'} Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:46:13.907951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.911458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.914192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Returning 404 to user: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:46:13.914192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-94812e44-a2fb-4f3d-90db-8fdde9488610 tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "DELETE /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 404 len: 111 microversion: 2.1 time: 0.037203 Aug 30 14:46:13.914192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 142/270] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:46:13 2022] DELETE /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:46:13.916358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:13.916358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] [instance: df889ee2-48d9-4b45-b6a3-64e3dc785b20] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:13.922714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:13.923218 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:13.923656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:13.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:13.924874 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:13.925295 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:13.949186 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] HTTP exception thrown: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Request method failure captured: Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 HTTP/1.1 Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJGs_VtYQUbs4GjdgWS7HQquXwTdbxEmgzSYG4oP92lSc-nv3vLmo7LlKmCgKLLcIdPb54lzNgSJatikPUa_jbPOrdhQjKoys-l6TP9gnUAI8uCDkdzAzQ8o70JMnVihMJBOaLK0dT3wUSDVl03j8U3JPSp0ws8lvUNhZChbxeqv0g Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:46:13.952416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/7914879d13ad4a589f93b0ce22538d06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_7914879d13ad4a589f93b0ce22538d06", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 7914879d13ad4a589f93b0ce22538d06 Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-DeleteServersTestJSON-1918305678 Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: ee02494e189d4823ab776ea3da9fd2ee Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-DeleteServersTestJSON-1918305678-project Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.953894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'df889ee2-48d9-4b45-b6a3-64e3dc785b20'} Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:46:13.954694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. Aug 30 14:46:13.958066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:46:13.960356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] Returning 404 to user: Instance df889ee2-48d9-4b45-b6a3-64e3dc785b20 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:46:13.960356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ee3695db-4ed0-437a-ae75-6935d3b06aaf tempest-DeleteServersTestJSON-1918305678 tempest-DeleteServersTestJSON-1918305678-project] 10.222.0.25 "GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20" status: 404 len: 111 microversion: 2.1 time: 0.044163 Aug 30 14:46:13.960356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 143/271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:13 2022] GET /compute/v2.1/servers/df889ee2-48d9-4b45-b6a3-64e3dc785b20 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 14:46:13.966785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:13.967436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:13.977468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:13.978315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:13.979081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:13.980422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:13.981967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:13.982706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:14.259861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:46:14.260889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:46:14.262110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:46:14.262811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:46:14.263478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:46:14.279329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:14.280329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:14.280564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:14.281685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:14.282949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:14.284030 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:14.284793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:14.297569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f8fa96b8-9b4b-4fad-aaf8-f004c88e6266 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.340213 Aug 30 14:46:14.306714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 144/272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:13 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:14.326507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Getting quotas for project 39e7bfd5fca640109a055032971dfcb7. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:46:14.332499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Getting quotas for user 5e260fff0fab4cd0979047116a1e3e32 and project 39e7bfd5fca640109a055032971dfcb7. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:46:14.360385 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:46:14.362808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:46:14.420689 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9f45e65e-5a59-4109-98fd-eb9d80bf69e5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697527 Aug 30 14:46:14.425590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 129/273] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:46:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:46:14.434007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b8c7f81f-9f75-48a3-8f8b-1b1084ff4288 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:14.435197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b8c7f81f-9f75-48a3-8f8b-1b1084ff4288 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:14.518326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b8c7f81f-9f75-48a3-8f8b-1b1084ff4288 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:14.527851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b8c7f81f-9f75-48a3-8f8b-1b1084ff4288 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1215 microversion: 2.1 time: 0.098011 Aug 30 14:46:14.553786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 145/274] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:14 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:15.332116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:15.333478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:15.336298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:15.343024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:15.343541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:15.344377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:15.345117 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:15.345574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:15.346003 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:15.543584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:15.571133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:15.572548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:15.590984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-96b86205-f753-484a-ad03-66ceff17d95e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.262955 Aug 30 14:46:15.595616 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 130/275] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:15 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:15.609167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:15.610173 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:15.611080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:15.612088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:15.612763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:15.613442 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:15.778634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:15.787548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8a65d61c-75fe-4b48-a1e7-19f26d508d98 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1267 microversion: 2.1 time: 0.222039 Aug 30 14:46:15.788284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 146/276] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:15 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:16.627982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:16.629467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:16.640302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:16.641191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:16.641859 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:16.642845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:16.643596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:16.644262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:16.812210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:16.814048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:16.823455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:16.824948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:16.826544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:16.827922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:16.828637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:16.829373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:16.952394 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:16.964900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:16.973332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b1d3bee6-0680-4285-849d-e67feeab1033 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1273 microversion: 2.1 time: 0.165143 Aug 30 14:46:16.973965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-209598d3-560b-4fd3-8c31-858881231d0b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.350102 Aug 30 14:46:16.975841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 147/277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:16 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:16.976971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 131/278] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:16 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:18.014797 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:18.016214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:18.020382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:18.026213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:18.032599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:18.033113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:18.033548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:18.037654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:18.039876 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:18.045822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:18.058816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:18.060195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:18.062066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:18.063685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:18.064604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:18.065351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:18.802591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:18.811081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:18.830745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-58a80de4-0b2a-459c-90c8-d785a7f3910d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.820598 Aug 30 14:46:18.832222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 132/279] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:18 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:18.847840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0004e1d7-bce8-4e86-a1c2-c2f249e05e56 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.842145 Aug 30 14:46:18.850513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 148/280] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:18 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:19.396135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-ca9361eb-c42b-4b66-9549-3831ac793189 req-29dd265b-203d-4e9f-9bf7-f0127557d05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47efda5a-8240-43e3-ae38-dacf1238f508", "tag": "f1859c45-8f98-47b6-b903-ec264524ad16"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:19.421409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-ca9361eb-c42b-4b66-9549-3831ac793189 req-29dd265b-203d-4e9f-9bf7-f0127557d05d service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:19.422653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-ca9361eb-c42b-4b66-9549-3831ac793189 req-29dd265b-203d-4e9f-9bf7-f0127557d05d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:19.423560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-ca9361eb-c42b-4b66-9549-3831ac793189 req-29dd265b-203d-4e9f-9bf7-f0127557d05d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:19.468435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-ca9361eb-c42b-4b66-9549-3831ac793189 req-29dd265b-203d-4e9f-9bf7-f0127557d05d service nova] Creating event network-changed:f1859c45-8f98-47b6-b903-ec264524ad16 for instance 47efda5a-8240-43e3-ae38-dacf1238f508 on hv-cinder-82880 Aug 30 14:46:19.479807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-ca9361eb-c42b-4b66-9549-3831ac793189 req-29dd265b-203d-4e9f-9bf7-f0127557d05d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090246 Aug 30 14:46:19.481611 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 133/281] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:19.876046 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:19.877988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:19.884189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:19.889678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:19.898101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:19.899468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:19.901245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:19.903471 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:19.905101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:19.906349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:19.912912 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:19.915119 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:19.916134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:19.928614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:19.929650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:19.930468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:20.633957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:20.643559 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:20.644548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b3662649-779e-4a28-a718-6e37f04ef0ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.779929 Aug 30 14:46:20.656956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 149/282] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:19 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:20.658572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b73527a2-e971-47da-8026-6b5cc6af3b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.785533 Aug 30 14:46:20.662721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 134/283] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:19 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:21.667462 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:21.668906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:21.675768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:21.676700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:21.677195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:21.677972 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:21.678578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:21.679225 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:21.699932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:21.701516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:21.715403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:21.716398 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:21.717164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:21.718466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:21.719375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:21.720407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:21.942510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:21.953362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2cfd8f84-333c-4ed0-8969-367675664722 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.289530 Aug 30 14:46:21.955118 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 150/284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:21 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:22.033606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:22.046019 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cdbca617-ec54-4846-af85-39e5b2127bed tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.353387 Aug 30 14:46:22.047149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 135/285] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:21 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:23.005311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:23.007635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:23.022888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:23.024572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:23.025877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:23.029359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:23.030616 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:23.044876 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:23.090056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:23.092648 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:23.114476 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:23.119420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:23.127006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:23.128471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:23.129339 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:23.130198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:23.523393 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:23.557907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d1598e55-1a87-42b9-b6df-79c0d6fc8309 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.565652 Aug 30 14:46:23.567010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 151/286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:22 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:23.572868 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:23.602479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-884b545c-f794-4153-a9ea-99f152df63a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.527737 Aug 30 14:46:23.603776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 136/287] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:23 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:24.599038 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:24.601195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:24.641892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:24.642731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:24.642873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:24.643972 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:24.645179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:24.645660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:24.646456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:24.646795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:24.647663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:24.648697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:24.656909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:24.668751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:24.669321 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:24.670637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:24.674874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:24.674874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:24.674874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:25.110509 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:25.143196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-79b2b191-4b3c-4c5f-886a-38dee7b8d871 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.551756 Aug 30 14:46:25.143809 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 152/288] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:24 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:25.153966 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:25.174763 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b7a46b6e-0775-4cc1-9765-c432c0f9b1df tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.544409 Aug 30 14:46:25.175820 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 137/289] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:24 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:26.186910 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:26.187831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:26.194674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:26.195258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:26.195755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:26.196562 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:26.197079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:26.199582 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:26.202690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:26.207229 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:26.231093 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:26.232198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:26.232904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:26.234372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:26.238218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:26.239026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:26.457869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:26.478009 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a0e7b084-20db-4ebe-94e4-8c8cc86bd43d tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.303300 Aug 30 14:46:26.496249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 153/290] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:26 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:26.542815 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:26.552560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a96259f1-ec1c-4f2f-958c-c5f39d61d9fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.357724 Aug 30 14:46:26.553418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 138/291] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:26 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:27.516566 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:27.519474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:27.531297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:27.532013 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:27.532698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:27.533540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:27.534150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:27.534750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:27.588695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:27.592757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:27.624477 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:27.625421 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:27.626088 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:27.627835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:27.628617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:27.632664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:27.829440 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:27.841356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e9c8ec69-d32d-4db8-838d-a75a6eee00ca tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.334341 Aug 30 14:46:27.841955 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 154/292] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:27 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:27.922665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:27.938372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5363c066-a6eb-4d9e-868e-de0c8e36eb47 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.363716 Aug 30 14:46:27.939058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 139/293] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:27 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:28.794131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-40433e6c-5c3a-4c05-a285-e8e8ea583fa1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: .version_select at 0x7fe6a65148b0>, body: {"keypair": {"name": "tempest-keypair-2098619881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZer4NIT0MbfuAPjwt8V6hbtAQuCoXQEwzju71OemxApO5VoK438RwtJP06Ustu3YaS8rPXeS0xM0Uhugs3ENO8qBv0N2NXjOwOM+m1G2oDoeOZR23gLc0/763jeVQVgg=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:28.828978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-40433e6c-5c3a-4c05-a285-e8e8ea583fa1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:46:28.841093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-40433e6c-5c3a-4c05-a285-e8e8ea583fa1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:46:28.864347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:28.865078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:28.869845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-40433e6c-5c3a-4c05-a285-e8e8ea583fa1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.267284 Aug 30 14:46:28.870763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 155/294] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:46:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:28.872268 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:28.872901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:28.873457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:28.874407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:28.874751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:28.875133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:28.960361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:28.961305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:28.968848 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:28.969394 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:28.970040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:28.970805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:28.971264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:28.971689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:29.088310 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:29.109979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a76ba820-d435-4002-8994-aa95de1063e2 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.250034 Aug 30 14:46:29.111421 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 140/295] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:28 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:29.205335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:29.215883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-02159043-2611-418f-b78f-238b8092a693 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.260646 Aug 30 14:46:29.216927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 156/296] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:28 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:30.132316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:30.133200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:30.141568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.142336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.142873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.143919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.144263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.144826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.250162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:30.250866 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:30.263871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.269503 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.272065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.273427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.273912 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.274574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.410845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:30.421263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c5caf754-0664-409c-94f3-e5c0868df4ac tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.293375 Aug 30 14:46:30.436031 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 141/297] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:30 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:30.541981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:30.555563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e5433a3f-fa3f-4e89-8377-30934ce20757 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.319597 Aug 30 14:46:30.557012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 157/298] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:30 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:30.728727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-824478304", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f"}], "security_groups": [{"name": "tempest-securitygroup--590136475"}], "key_name": "tempest-keypair-2098619881", "user_data": "}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:30.855493 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] validate_networks() for [('d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:46:31.281530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:46:31.282108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:46:31.282400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:46:31.282802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:46:31.283207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:46:31.293703 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.294188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.295589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.296374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.296828 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.297246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.320377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:46:31.325765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:46:31.337093 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:46:31.339522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:46:31.400591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0d869c17-950b-4a21-8446-d97820f3f8d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676240 Aug 30 14:46:31.401560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 142/299] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:46:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:46:31.417201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b2396fef-653c-48ee-b529-4db4b22f4fbe tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:31.418332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b2396fef-653c-48ee-b529-4db4b22f4fbe tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:31.453767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:31.455170 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:31.470517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.471018 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.471446 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.472374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.472984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.473543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.477159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:31.501612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b2396fef-653c-48ee-b529-4db4b22f4fbe tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:31.509344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b2396fef-653c-48ee-b529-4db4b22f4fbe tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1241 microversion: 2.1 time: 0.099759 Aug 30 14:46:31.509917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 158/300] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:31 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:31.577736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:31.578314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:31.594483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.595287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.595891 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.597098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.601075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.601848 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.647897 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:31.673102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:31.689978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-542b02e1-bf18-4d3d-9cff-09f95d30e15b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.244560 Aug 30 14:46:31.692049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 143/301] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:31 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:31.820605 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:31.831486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0a7f1fe0-9187-4fe7-b677-df0e28011c39 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.257650 Aug 30 14:46:31.832365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 159/302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:31 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:32.533097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:32.533699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:32.540778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.541371 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.541864 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.542704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.543817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.544388 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.622004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:32.633043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8fb45f96-ed9e-4fdc-8c58-3a56837d050c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1245 microversion: 2.1 time: 0.103802 Aug 30 14:46:32.634476 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 144/303] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:32 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:32.711781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:32.714420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:32.728860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.729937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.731396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.732203 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.732669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.733149 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.857125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:32.857757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:32.863937 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.864607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.865114 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.865899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.866640 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.867139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.895506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:32.904259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-52c5ac6a-658d-40b4-bb26-5979de8986ae tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.196846 Aug 30 14:46:32.905529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 160/304] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:32 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:33.054546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:33.069286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b7d5428a-7f72-43eb-83bd-b6b8e42901f2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.218656 Aug 30 14:46:33.071009 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 145/305] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:32 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:33.655124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:33.655731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:33.662172 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:33.662651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:33.663075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:33.663770 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:33.664241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:33.664661 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:33.736092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:33.744549 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cbbc2d9a-36ac-433d-ab62-d164dd84be5b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1245 microversion: 2.1 time: 0.093353 Aug 30 14:46:33.745108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 161/306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:33 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:33.939431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:33.940137 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:33.947896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:33.948770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:33.949341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:33.950041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:33.950817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:33.951244 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:34.092147 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:34.092835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:34.100259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:34.100911 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:34.101719 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:34.103497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:34.104412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:34.105120 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:34.109793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:34.120725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f2a3b9d3-081a-4fbf-8c38-f0debc4220e4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.185487 Aug 30 14:46:34.122264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 146/307] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:33 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:34.276424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:34.286216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-79940f68-8cc0-4735-9650-87ce4b3c34a9 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.199146 Aug 30 14:46:34.286956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 162/308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:34 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:34.766091 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:34.766683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:34.773597 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:34.774079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:34.774505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:34.775393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:34.775843 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:34.776295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:34.842916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:34.851396 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-722b6a5d-9815-4b41-b8e2-d289d8921b1c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1245 microversion: 2.1 time: 0.089163 Aug 30 14:46:34.852006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 147/309] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:34 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:35.142933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:35.143948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:35.150647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.151128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.151558 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.152318 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.152773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.153199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.306709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:35.307332 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:35.315149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.315709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.316219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.316762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:35.316929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.317340 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.317787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.325373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b888af55-3467-4e2b-8d70-4e7b873985f0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.186675 Aug 30 14:46:35.330672 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 163/310] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:35 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:35.462764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:35.471057 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a89072b4-c373-41f2-9dff-bb68fc3b7db0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.168136 Aug 30 14:46:35.471609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 148/311] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:35 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:35.877329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:35.879357 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:35.887302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.887957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.888413 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.889107 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.889554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.889970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.960265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:35.969035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-40a30a9a-426b-4045-b22f-4330860187b3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1245 microversion: 2.1 time: 0.097408 Aug 30 14:46:35.969603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 164/312] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:35 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:36.349834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:36.350678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:36.357913 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.358171 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.358628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:36.359336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.359782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.360692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:36.493963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:36.494591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:36.501361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.501855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.502281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:36.502993 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.503472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.503861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:36.713783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:36.723366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-97edb136-6a02-4734-af68-3cddc11c2d52 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.233775 Aug 30 14:46:36.724272 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 165/313] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:36 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:36.726817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:36.736237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8e07705f-00d8-48d3-a25d-6e26ce95cf97 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.391672 Aug 30 14:46:36.736937 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 149/314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:36 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:36.990340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:36.990939 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:36.997362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.997949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.998380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:36.999076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.999508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.999921 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:37.068049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:37.083235 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1163a6f5-4ea5-4492-bb3b-674a16bb9516 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1245 microversion: 2.1 time: 0.096725 Aug 30 14:46:37.083828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 166/315] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:36 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:37.749237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:37.750814 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:37.759151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:37.759759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:37.770694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:37.772292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:37.772690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:37.773409 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:37.774107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:37.775109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:37.775761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:37.776542 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:37.777590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:37.778398 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:37.778726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:37.779205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:38.026663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:38.036230 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d9788dad-250b-4c12-99fd-f0c94dd59dc9 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.281069 Aug 30 14:46:38.036813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 167/316] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:37 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:38.041983 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:38.060721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0180b823-21db-4708-abbb-5b3f5d4a2433 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.314578 Aug 30 14:46:38.064260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 150/317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:37 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:38.105059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:38.105700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:38.112466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:38.112954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:38.113435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:38.114142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:38.114590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:38.115013 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:38.183845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:38.193064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-daed4627-858a-4765-8865-ab1e11810452 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1293 microversion: 2.1 time: 0.091851 Aug 30 14:46:38.193676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 168/318] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:38 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:39.059182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:39.060409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:39.069788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.070480 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.070958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.071677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.072147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.072569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.092909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:39.093573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:39.101286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.101771 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.102197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.102895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.103335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.103754 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.503646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:39.518108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5bd58a1a-4188-420a-8372-f758ae4f9fc0 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.462711 Aug 30 14:46:39.532631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 151/319] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:39 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:39.535888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:39.538176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:39.538772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:39.545427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.545915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.546349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.547062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.547494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.547620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d1e8da66-b127-4b97-92e0-5ee2189eb34e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.459893 Aug 30 14:46:39.548224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.548361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 169/320] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:39 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:39.615300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:39.623720 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0d8b9431-2980-416a-95eb-3c5e97274179 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1293 microversion: 2.1 time: 0.089626 Aug 30 14:46:39.624347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 152/321] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:39 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:40.539404 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:40.540310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:40.542321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:40.548434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:40.548922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:40.549558 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:40.551015 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:40.551484 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:40.551919 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:40.583674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:40.585628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:40.594538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:40.595479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:40.596189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:40.597225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:40.597765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:40.598282 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:40.957767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:40.980831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-edd34248-95bb-4eb4-bb6a-acf63a94ef73 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.445271 Aug 30 14:46:40.981414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:40.982229 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 170/322] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:40 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:40.992654 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cd8e1f4b-dc4e-4bce-8b42-e29fe15c3322 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1521 microversion: 2.1 time: 0.413600 Aug 30 14:46:41.001190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-24bbaa3f-80af-4afa-b9da-dea114d2c38d req-9832a55e-c903-4d96-9f69-93bd335f0ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47efda5a-8240-43e3-ae38-dacf1238f508", "name": "network-vif-plugged", "status": "completed", "tag": "f1859c45-8f98-47b6-b903-ec264524ad16"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:41.007472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 153/323] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:40 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:41.013531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-24bbaa3f-80af-4afa-b9da-dea114d2c38d req-9832a55e-c903-4d96-9f69-93bd335f0ac7 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:41.015648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-24bbaa3f-80af-4afa-b9da-dea114d2c38d req-9832a55e-c903-4d96-9f69-93bd335f0ac7 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:41.016115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-24bbaa3f-80af-4afa-b9da-dea114d2c38d req-9832a55e-c903-4d96-9f69-93bd335f0ac7 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:41.025917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:41.027572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:41.031927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-24bbaa3f-80af-4afa-b9da-dea114d2c38d req-9832a55e-c903-4d96-9f69-93bd335f0ac7 service nova] Creating event network-vif-plugged:f1859c45-8f98-47b6-b903-ec264524ad16 for instance 47efda5a-8240-43e3-ae38-dacf1238f508 on hv-cinder-82880 Aug 30 14:46:41.039297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:41.039613 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-24bbaa3f-80af-4afa-b9da-dea114d2c38d req-9832a55e-c903-4d96-9f69-93bd335f0ac7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050372 Aug 30 14:46:41.040303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 171/324] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:41.041273 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:41.042041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:41.043397 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:41.044152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:41.045297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:41.184147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:41.193374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e7aaab27-2328-4dcc-991a-b1e336626371 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1299 microversion: 2.1 time: 0.183934 Aug 30 14:46:41.208417 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 154/325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:41 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:42.005866 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:42.010477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:42.011237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:42.018286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.018773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.019359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.020062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.020526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.020935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.027517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:42.028929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:42.030841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:42.032070 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:42.040491 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.040994 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.041416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.042118 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.042559 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.042958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.239468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:42.249515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:42.250821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6356c756-e191-47e5-b99d-07edc55317f7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.245875 Aug 30 14:46:42.251538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 172/326] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:42 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:42.261629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:42.262596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:42.263833 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-701c31d2-4cbb-418a-b8fb-4d3346176925 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1501 microversion: 2.1 time: 0.240246 Aug 30 14:46:42.265597 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 155/327] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:42 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:42.279661 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.280308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.280825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.281618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.282368 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.282689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.287409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:42.288096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:42.294324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.294819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.295254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.296025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.296489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.296906 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.614162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:42.622954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5bcad74c-fbc0-4df1-885a-8bea14c119d8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.369871 Aug 30 14:46:42.623840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:42.632767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 173/328] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:42 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:42.633507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a8289cd9-16d7-4c99-ab3d-19a1e3a40b93 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1515 microversion: 2.1 time: 0.349728 Aug 30 14:46:42.634197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 156/329] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:42 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1515 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:43.181388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-d219a802-045d-4120-81be-e8a265fc3f76 req-e69bd8c4-271a-49d3-ae36-ed04a0d187ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bec4834-0075-439c-bca0-5c5abf786d13", "tag": "886589e5-9a1e-4347-ba30-b804fb5e471a"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:43.193152 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d219a802-045d-4120-81be-e8a265fc3f76 req-e69bd8c4-271a-49d3-ae36-ed04a0d187ad service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:43.193434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d219a802-045d-4120-81be-e8a265fc3f76 req-e69bd8c4-271a-49d3-ae36-ed04a0d187ad service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:43.193778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-d219a802-045d-4120-81be-e8a265fc3f76 req-e69bd8c4-271a-49d3-ae36-ed04a0d187ad service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:43.206912 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-d219a802-045d-4120-81be-e8a265fc3f76 req-e69bd8c4-271a-49d3-ae36-ed04a0d187ad service nova] Creating event network-changed:886589e5-9a1e-4347-ba30-b804fb5e471a for instance 6bec4834-0075-439c-bca0-5c5abf786d13 on hv-cinder-82880 Aug 30 14:46:43.212704 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-d219a802-045d-4120-81be-e8a265fc3f76 req-e69bd8c4-271a-49d3-ae36-ed04a0d187ad service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034939 Aug 30 14:46:43.213559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 174/330] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:43.279828 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:43.280582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:43.290272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:43.291063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:43.291771 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:43.293013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:43.293753 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:43.294880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:43.523645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:43.532196 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e53ee39e-8a8e-49b2-9dd3-3964789997c4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1315 microversion: 2.1 time: 0.256979 Aug 30 14:46:43.532773 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 157/331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:43 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:43.644395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:43.645089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:43.651455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:43.651930 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:43.652391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:43.653086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:43.653585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:43.653996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:43.839648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:43.847873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-40a4689c-2c3f-4c1b-9144-5f1e1dcde203 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.207921 Aug 30 14:46:43.848452 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 175/332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:43 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:44.553864 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:44.554700 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:44.562069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.562552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.563009 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.563680 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.564173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.564574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.752812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:44.760884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4573e499-6cc3-4608-b473-d73eaade3264 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1464 microversion: 2.1 time: 0.211083 Aug 30 14:46:44.761451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 158/333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:44 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1464 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:44.814342 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:44.815066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:44.822930 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.823497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.824728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.824728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.825098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.825647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.851935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:46:44.879942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:44.887043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:44.887043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:44.893833 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.894584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.895328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.896115 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.896728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.897284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.956353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-afcd9145-834b-4426-b2ec-e81b110328b4 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "DELETE /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 204 len: 0 microversion: 2.1 time: 0.146019 Aug 30 14:46:44.957798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 176/334] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:46:44 2022] DELETE /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 14:46:44.967831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:44.969864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:44.978031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.978615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.979133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.980026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:44.981101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:44.981966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.259104 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:45.263284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:45.264911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:45.277545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4f935743-955e-4738-834f-0635ef89e2ba tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.314685 Aug 30 14:46:45.278191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-145a2cff-3661-457b-a349-5023882145c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.396191 Aug 30 14:46:45.279692 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 177/335] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:44 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:45.284678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 159/336] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:44 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:45.289182 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:45.293125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:45.305370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.305815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.306255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.306970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.307436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.307855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.338808 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'flavor' on Instance uuid ec5ebea7-409d-4e00-9a26-030000cdb28b {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:46:45.460690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-16dd89e4-e7b4-4d70-84b2-35c20cda857d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b/action" status: 200 len: 32 microversion: 2.1 time: 0.178956 Aug 30 14:46:45.461704 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 178/337] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:46:45 2022] POST /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:46:45.476342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:45.477640 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:45.480176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:45.487800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.488345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.488774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.489465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.489926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.490340 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.661440 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:45.673513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b8e3f5ba-a0f4-4f49-9d63-2366a1cd5424 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.204162 Aug 30 14:46:45.674284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 160/338] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:45 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:46.304115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:46.304719 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:46.308648 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:46.309259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:46.311827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.312346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.312777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.313473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.313951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.314359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.317355 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.317873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.318304 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.319020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.319468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.319895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.709971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:46.723307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:46.731458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4ec57dd7-13be-4193-90d8-be6fb8bc2629 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.427916 Aug 30 14:46:46.740697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 179/339] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:46 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:46.741001 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-07318aa4-e810-468f-b927-33010724c5c5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.433805 Aug 30 14:46:46.741001 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 161/340] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:46 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:46.754747 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:46.755434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:46.762238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.763137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.763747 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.764485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.764938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.765355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.943740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:46.952553 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-849cd69d-09c6-4545-b0bd-2b5b982c8384 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.218334 Aug 30 14:46:46.953115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 180/341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:46 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:47.763838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:47.765302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:47.770878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:47.772642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.772783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:47.773254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.774027 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:47.774947 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.775685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.776519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:47.785773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.786617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.787804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:47.789805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.793436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.794238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:48.012921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:48.019396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:48.021613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-53ca9960-1093-4361-bff7-2cae08654641 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.264490 Aug 30 14:46:48.022188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 162/342] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:47 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:48.026963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:48.027562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:48.034058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:48.034607 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8c407477-daa3-4598-b639-7ad1b90881b5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.271163 Aug 30 14:46:48.034860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:48.035450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:48.036112 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 181/343] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:47 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:48.036303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:48.036631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:48.037102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:48.190169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:48.199552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8886e057-6b37-4c8b-aa1f-d12b5ece8a38 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.176228 Aug 30 14:46:48.200233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 163/344] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:48 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:49.046082 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:49.046676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:49.053374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.053837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.058303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.058303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.058303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.058303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.058641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:49.058641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:49.066169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.066687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.067147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.067873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.068379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.068824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.278379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:49.283385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:49.286663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7d46404d-3579-4ca1-a54d-dacb15cb8615 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.232905 Aug 30 14:46:49.287308 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 164/345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:49 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:49.291962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:49.292156 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a7e565e8-18ec-4f4c-a4ae-6356b7923673 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.249934 Aug 30 14:46:49.292998 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:49.293106 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 182/346] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:49 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:49.309141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.310348 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.311963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.312967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.313748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.314715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.467986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:49.476124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-68ba2243-fbc7-4e6a-b45b-5299d039d15f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.187645 Aug 30 14:46:49.476702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 165/347] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:49 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:50.308973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:50.310118 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:50.313890 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:50.314479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:50.317891 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.318574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.319035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.320456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.320888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.321339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.321698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.322321 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.322734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.323392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.323956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.324247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.540137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:50.546226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:50.548667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1a2f996b-63b2-40ad-b97d-833d2bdae4a8 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.243547 Aug 30 14:46:50.549226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 183/348] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:50 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:50.553776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:50.554269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e11293b3-f70d-437f-9726-11ebcbcf500e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.245775 Aug 30 14:46:50.554380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:50.554841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 166/349] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:50 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:50.561290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.561636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.562070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.563071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.563421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.564021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.711777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:50.720836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e43a1362-ef6d-42db-a083-8fec7c3ae8cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.170535 Aug 30 14:46:50.721445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 184/350] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:50 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:51.572589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:51.573556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:51.582563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:51.582563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:51.584804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.585596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.586302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.587467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.588234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.588941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.591305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.592119 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.592801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.594017 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.594789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.595508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.822180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:51.825281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:51.830418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-92dadab9-5192-49e7-bd0e-89bba39e617f tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.263164 Aug 30 14:46:51.830954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 167/351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:51 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:51.835749 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:51.836377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:51.838903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a465b4ce-12a3-41b6-b25f-c784ffca46db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.267374 Aug 30 14:46:51.843158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 185/352] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:51 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:51.843431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.843753 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.844453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.845381 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.845853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.846272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.987451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:51.996417 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a14003be-e05d-45f7-ad9c-5a8423be3fba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.164355 Aug 30 14:46:51.997034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 168/353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:51 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:52.726837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-fc65b8a0-d578-473e-acd2-ff63acb05950 req-3c005166-2835-49e3-87ae-722da03661d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47efda5a-8240-43e3-ae38-dacf1238f508", "name": "network-vif-unplugged", "status": "completed", "tag": "f1859c45-8f98-47b6-b903-ec264524ad16"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:52.736863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fc65b8a0-d578-473e-acd2-ff63acb05950 req-3c005166-2835-49e3-87ae-722da03661d2 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.737341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fc65b8a0-d578-473e-acd2-ff63acb05950 req-3c005166-2835-49e3-87ae-722da03661d2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.737765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fc65b8a0-d578-473e-acd2-ff63acb05950 req-3c005166-2835-49e3-87ae-722da03661d2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.756608 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-fc65b8a0-d578-473e-acd2-ff63acb05950 req-3c005166-2835-49e3-87ae-722da03661d2 service nova] Creating event network-vif-unplugged:f1859c45-8f98-47b6-b903-ec264524ad16 for instance 47efda5a-8240-43e3-ae38-dacf1238f508 on hv-cinder-82880 Aug 30 14:46:52.765976 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-fc65b8a0-d578-473e-acd2-ff63acb05950 req-3c005166-2835-49e3-87ae-722da03661d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042079 Aug 30 14:46:52.767051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 186/354] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:52.851283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:52.851886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:52.858831 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.859389 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.859823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.860729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.861185 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.861346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:52.861603 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.862031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:52.868583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.869061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.869484 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.870245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.870887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.871240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:53.074110 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:53.078552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:53.086833 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1de289fd-5cc0-4bec-aba6-8be0310fa185 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.239703 Aug 30 14:46:53.099667 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 169/355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:52 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:53.099913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a0f3628e-ec23-4434-8030-9f6a93b2cff3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.231112 Aug 30 14:46:53.100271 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:53.100395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 187/356] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:52 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:53.100482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:53.100482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:53.100482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:53.100482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:53.100765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:53.101107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:53.101728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:53.273960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:53.282708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5eb7d7bd-c640-4cf5-8b2c-f2fbd43a85af tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.194218 Aug 30 14:46:53.283287 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 170/357] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:53 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:54.109794 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:54.110507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:54.111589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:54.112309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:54.117755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.118376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.118825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.119540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.119785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.119989 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.120314 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.120481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.120748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.121454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.121916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.122348 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.564669 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:54.571703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:54.573467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-78f7875b-246e-4cb7-bc2c-0cd1009624be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.466599 Aug 30 14:46:54.574054 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 171/358] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:54 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:54.581339 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:54.582270 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:54.588634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8c14bc57-c5ab-4e59-9bcf-a2d37e4faa2c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.482908 Aug 30 14:46:54.589613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.590099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.590693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.591499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.591798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.592244 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.594956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 188/359] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:54 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:54.742407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:54.753393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-79bbc5f6-476e-43ad-8860-7ecfadd19040 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.178126 Aug 30 14:46:54.753952 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 172/360] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:54 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:55.595540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:55.596155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:55.602980 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.603461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.603887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.604625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.605223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.605496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.610810 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:55.611498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:55.618302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.618792 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.619237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.620204 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.620656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.621074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.808767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:55.818026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05a6e364-dcf0-41ef-9be6-6ec4b6c142d6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.226577 Aug 30 14:46:55.818616 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 189/361] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:55 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:55.822371 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:55.823201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:55.823802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:55.830092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.830868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.831326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.831455 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-88b87cbd-6f02-4ee0-9117-8519fbb23fc7 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.224801 Aug 30 14:46:55.837838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 173/362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:55 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:55.838031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.838031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.838031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.980400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:55.989751 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a80ffbff-d7fa-4a2f-a037-99c661550118 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.170175 Aug 30 14:46:55.990313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 190/363] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:55 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:56.843021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:56.843715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:56.854233 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:56.855059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:56.860581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.861066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.861494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.862247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.862655 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.863069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.864674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.865786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.866898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.869599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.869599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.869942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.880036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:57.090767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:57.100094 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fb766e90-a715-4f26-94a0-d85fbece427e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.261421 Aug 30 14:46:57.100683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 174/364] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:56 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:57.105249 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:57.105846 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:57.112134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:57.112688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:57.113109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:57.113801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:57.114425 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:57.114845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:57.123385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:57.132577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-12a42d65-aaab-42fd-ac58-309c800c3c3b tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.282058 Aug 30 14:46:57.133179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 191/365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:56 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:57.263884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:57.273601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e6e3b034-e8bc-4871-8e87-5cfcedede0dc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.171849 Aug 30 14:46:57.274187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 175/366] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:57 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:58.132122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:58.132779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:58.139243 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.139726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.140192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.140899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.141341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.141755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.154227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:58.156289 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:58.164403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.164403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.164403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.164403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.164846 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.167523 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.198588 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:58.558609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:58.567633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-92c2c156-c7a3-42f3-bac5-84c950e97a7d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.440265 Aug 30 14:46:58.568287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 192/367] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:58 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:58.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:58.573501 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:58.580233 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.581458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.582260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.583253 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.584089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.584517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.597225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:58.607929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f4f69cd9-73f5-42d6-a383-a3319405c4a5 tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1470 microversion: 2.1 time: 0.457580 Aug 30 14:46:58.608679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 176/368] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:58 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1470 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:58.784872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:58.793129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-96bb30fa-ceb7-4c64-9b51-9709f40f8e22 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.223838 Aug 30 14:46:58.793717 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 193/369] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:58 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:58.880663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-2ab4999e-52df-4744-a7fc-4b453b883c59 req-4348924a-49e6-45cb-bb47-963ed82687cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47efda5a-8240-43e3-ae38-dacf1238f508", "name": "network-vif-deleted", "tag": "f1859c45-8f98-47b6-b903-ec264524ad16"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:58.890988 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2ab4999e-52df-4744-a7fc-4b453b883c59 req-4348924a-49e6-45cb-bb47-963ed82687cb service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.891836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2ab4999e-52df-4744-a7fc-4b453b883c59 req-4348924a-49e6-45cb-bb47-963ed82687cb service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.892049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2ab4999e-52df-4744-a7fc-4b453b883c59 req-4348924a-49e6-45cb-bb47-963ed82687cb service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.904082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-2ab4999e-52df-4744-a7fc-4b453b883c59 req-4348924a-49e6-45cb-bb47-963ed82687cb service nova] Creating event network-vif-deleted:f1859c45-8f98-47b6-b903-ec264524ad16 for instance 47efda5a-8240-43e3-ae38-dacf1238f508 on hv-cinder-82880 Aug 30 14:46:58.909139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-2ab4999e-52df-4744-a7fc-4b453b883c59 req-4348924a-49e6-45cb-bb47-963ed82687cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032297 Aug 30 14:46:58.909801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 177/370] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:59.383486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-82b2ef3c-4141-4cf9-a66f-25662e17d616 req-ef51904c-7732-41db-b69d-4a4dc4a87a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bec4834-0075-439c-bca0-5c5abf786d13", "name": "network-vif-plugged", "status": "completed", "tag": "886589e5-9a1e-4347-ba30-b804fb5e471a"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:59.394877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-82b2ef3c-4141-4cf9-a66f-25662e17d616 req-ef51904c-7732-41db-b69d-4a4dc4a87a34 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.395579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-82b2ef3c-4141-4cf9-a66f-25662e17d616 req-ef51904c-7732-41db-b69d-4a4dc4a87a34 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.396201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-82b2ef3c-4141-4cf9-a66f-25662e17d616 req-ef51904c-7732-41db-b69d-4a4dc4a87a34 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.410058 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-82b2ef3c-4141-4cf9-a66f-25662e17d616 req-ef51904c-7732-41db-b69d-4a4dc4a87a34 service nova] Creating event network-vif-plugged:886589e5-9a1e-4347-ba30-b804fb5e471a for instance 6bec4834-0075-439c-bca0-5c5abf786d13 on hv-cinder-82880 Aug 30 14:46:59.421681 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-82b2ef3c-4141-4cf9-a66f-25662e17d616 req-ef51904c-7732-41db-b69d-4a4dc4a87a34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041887 Aug 30 14:46:59.422767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 194/371] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:59.594368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:59.595731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:59.605365 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.605910 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.606370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.607104 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.607585 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.608104 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:59.631282 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:59.638158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.638732 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.639326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.641198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.641669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.642103 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.678922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.679394 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.679816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.680288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lazy-loading 'fault' on Instance uuid 47efda5a-8240-43e3-ae38-dacf1238f508 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:46:59.744811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e260fff0fab4cd0979047116a1e3e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e7bfd5fca640109a055032971dfcb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:59.754549 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0caf0711-15be-49fe-9d75-8c272a4ea97c tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 200 len: 1305 microversion: 2.1 time: 0.128433 Aug 30 14:46:59.755165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 195/372] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:59 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:59.786350 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:59.797952 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f10d6f82-c7ca-4059-b0a9-1d6a8aac273a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.211819 Aug 30 14:46:59.798535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 178/373] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:59 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:59.816490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:59.817261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:59.825363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.825851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.826466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.827168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.827611 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.828245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.035091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:00.044668 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d83d557-43fd-4624-9d64-a3c2c3f8050c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.232102 Aug 30 14:47:00.045248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 196/374] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:59 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:00.779527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:00.780451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] [instance: 47efda5a-8240-43e3-ae38-dacf1238f508] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:00.787526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.788201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.788687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.791583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.792145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.792610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.814715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] HTTP exception thrown: Instance 47efda5a-8240-43e3-ae38-dacf1238f508 could not be found. Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Request method failure captured: Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 HTTP/1.1 Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiKyRgnRjOZqijD9C9BgFxIxtIz_2cHv_YoA7GXYxsi_2mQBBQYh2rsCUVntROI0tEYoEbxBNpyb_0s_XgVR8ziRe7KJMGCOzzSqrRPuwJUcPFA0ACXzloaTu2JlHZH_tUtLuOXWR1Js4zETvuFe3WWZImQXedBziwWXAr8y_OBvHF8 Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 39e7bfd5fca640109a055032971dfcb7 Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-VolumesNegativeTest-1022461478 Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:47:00.817420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e7bfd5fca640109a055032971dfcb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/39e7bfd5fca640109a055032971dfcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/39e7bfd5fca640109a055032971dfcb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_39e7bfd5fca640109a055032971dfcb7", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-VolumesNegativeTest-1022461478 Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 39e7bfd5fca640109a055032971dfcb7 Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-VolumesNegativeTest-1022461478 Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-VolumesNegativeTest-1022461478-project Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 5e260fff0fab4cd0979047116a1e3e32 Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-VolumesNegativeTest-1022461478-project Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 47efda5a-8240-43e3-ae38-dacf1238f508 could not be found. Aug 30 14:47:00.819338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '47efda5a-8240-43e3-ae38-dacf1238f508'} Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47efda5a-8240-43e3-ae38-dacf1238f508 could not be found. Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:47:00.820228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47efda5a-8240-43e3-ae38-dacf1238f508 could not be found. Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47efda5a-8240-43e3-ae38-dacf1238f508 could not be found. Aug 30 14:47:00.821738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:00.823415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] Returning 404 to user: Instance 47efda5a-8240-43e3-ae38-dacf1238f508 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:47:00.823415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-de99fb03-c5c0-46da-aa43-4fadf8988dce tempest-VolumesNegativeTest-1022461478 tempest-VolumesNegativeTest-1022461478-project] 10.222.0.25 "GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508" status: 404 len: 111 microversion: 2.1 time: 0.045131 Aug 30 14:47:00.823415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 179/375] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:00 2022] GET /compute/v2.1/servers/47efda5a-8240-43e3-ae38-dacf1238f508 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:47:00.826847 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:00.827698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:00.836417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.836921 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.837360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.838105 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.838558 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.838980 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:01.069438 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:01.071399 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:01.072328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:01.081485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cd5d78bc-7bd9-4989-be9c-062399d200af tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.265157 Aug 30 14:47:01.082777 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:01.082967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 197/376] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:00 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:01.083977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:01.084634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:01.085562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:01.086268 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:01.086765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:01.310295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:01.324362 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-94e4dd34-be75-48aa-8824-0628712bc48a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.254023 Aug 30 14:47:01.324362 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 180/377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:01 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:02.102742 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:02.103343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:02.109572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.110062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.110471 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.111161 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.111620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.112031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.258941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:02.268334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4e746e4d-3875-4b62-a0da-fca549415b5f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1366 microversion: 2.1 time: 0.169269 Aug 30 14:47:02.269956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 198/378] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:02 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:02.347762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:02.348411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:02.355433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.355943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.356407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.357100 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.357545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.357960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.539047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:02.548055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0e65cc4c-8d86-4d05-91cd-7547d7c74516 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.210515 Aug 30 14:47:02.548934 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 181/379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:02 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:03.298994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:03.303055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:03.341268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.343339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.347441 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.348826 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.349135 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.349671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.619311 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:03.621298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:03.648871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:03.654705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.655447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.656555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.657851 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.659003 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.660264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.671114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-799610f1-d41f-484b-b29a-feff3771a9ca tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1557 microversion: 2.1 time: 0.381314 Aug 30 14:47:03.690558 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 199/380] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:03 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1557 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:03.709067 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:03.712252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:03.727203 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.727842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.729707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.731585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.732632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.733812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.926308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-94109870-284f-4493-8b8d-a1cb50a74f3b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233782 Aug 30 14:47:03.927088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 200/381] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:47:03 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:03.994725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:04.008869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a1477059-2f53-4b2a-b8ef-e1b91f096255 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.435728 Aug 30 14:47:04.009830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 182/382] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:03 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:05.032603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:05.033765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:05.042473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:05.043216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:05.043871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:05.044789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:05.045399 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:05.046140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:05.286213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:05.289472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ab28cbb7-13d7-4344-953d-016cdb853ac3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.261866 Aug 30 14:47:05.291050 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 201/383] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:05 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:05.796450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-a680aa5c-1d10-4de5-aac6-60fde3726125 req-972712ec-f44a-48c3-a77a-27b9ec3a0657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bec4834-0075-439c-bca0-5c5abf786d13", "tag": "886589e5-9a1e-4347-ba30-b804fb5e471a"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:05.822004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-a680aa5c-1d10-4de5-aac6-60fde3726125 req-972712ec-f44a-48c3-a77a-27b9ec3a0657 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:05.823232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-a680aa5c-1d10-4de5-aac6-60fde3726125 req-972712ec-f44a-48c3-a77a-27b9ec3a0657 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:05.824590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-a680aa5c-1d10-4de5-aac6-60fde3726125 req-972712ec-f44a-48c3-a77a-27b9ec3a0657 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:05.853135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-a680aa5c-1d10-4de5-aac6-60fde3726125 req-972712ec-f44a-48c3-a77a-27b9ec3a0657 service nova] Creating event network-changed:886589e5-9a1e-4347-ba30-b804fb5e471a for instance 6bec4834-0075-439c-bca0-5c5abf786d13 on hv-cinder-82880 Aug 30 14:47:05.863909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-a680aa5c-1d10-4de5-aac6-60fde3726125 req-972712ec-f44a-48c3-a77a-27b9ec3a0657 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071252 Aug 30 14:47:05.865174 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 183/384] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:06.326765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:06.328486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:06.338217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:06.338716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:06.339156 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:06.339876 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:06.341565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:06.342007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:06.648052 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:06.656326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0dc62a24-550c-46af-83b5-540a7b4d34db tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.333940 Aug 30 14:47:06.656982 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 202/385] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:06 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:07.678599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:07.679262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:07.686098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:07.686567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:07.686990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:07.687666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:07.688134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:07.688613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:07.976886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:07.985140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a5a72ff9-5bcb-4a7e-9daa-78f408296aa6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.311349 Aug 30 14:47:07.985701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 184/386] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:07 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:09.007965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:09.008618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:09.015535 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:09.016202 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:09.016504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:09.017336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:09.017850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:09.018337 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:09.178812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:09.187518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ea6e6dda-06ce-4e94-843f-c49cbabd11e0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.183749 Aug 30 14:47:09.188353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 203/387] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:09 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:10.210426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:10.211344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:10.218565 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:10.219238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:10.219822 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:10.220824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:10.221442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:10.222006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:10.463308 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:10.471276 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b318e534-cbd1-4f98-91d0-28eaac7165e5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.265097 Aug 30 14:47:10.471850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 185/388] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:10 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:11.494457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:11.495073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:11.497218 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:11.503145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:11.503540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:11.503965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:11.504697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:11.505140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:11.505597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:11.663241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:11.674075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a6343d25-882a-4cdc-94fc-625da7d9f041 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.183825 Aug 30 14:47:11.674807 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 204/389] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:11 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:12.703080 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:12.703718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:12.710730 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:12.711223 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:12.711813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:12.712535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:12.712979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:12.713392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:12.858297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:12.866675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-26308d47-acb7-4666-8ff6-deaec9d0a7d4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.167516 Aug 30 14:47:12.867268 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 186/390] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:12 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:13.889383 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:13.889991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:13.896677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:13.897152 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:13.897584 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:13.898286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:13.898744 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:13.899166 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:14.062382 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:14.074471 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-522f5f60-88fb-42c2-bcfe-74a225a03e79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.188887 Aug 30 14:47:14.075094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 205/391] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:13 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:15.096457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:15.097158 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:15.104816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.105299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.105731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.106426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.106872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.107284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.267425 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:15.276641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-63ab041e-a70e-48cd-94fe-6b5afdf810fa tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.184048 Aug 30 14:47:15.277283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 187/392] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:15 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:16.298525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:16.299511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:16.307226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.308045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.308724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:16.310266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.310892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.311351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:16.457771 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:16.466474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8c31c39d-c6f4-43e7-8306-4077b0b9135c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.172296 Aug 30 14:47:16.467075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 206/393] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:16 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:17.488676 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:17.489322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:17.491926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=56 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:17.497875 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:17.498296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:17.498722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.499430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:17.500036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:17.500467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.674870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:17.683684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-81a08aa9-23f5-44c4-b0e1-0a723e7bc6ce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.198827 Aug 30 14:47:17.684967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 188/394] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:17 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:18.717579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:18.719670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:18.733781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.734921 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.735854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.737682 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.738713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.741135 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.385931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:19.407067 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-21131241-1e5c-48bb-92d3-ec20f27f42ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.697994 Aug 30 14:47:19.407989 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 207/395] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:18 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:20.442940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:20.443671 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:20.451455 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.452608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.452608 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.453307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.453660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.454083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.943444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:20.969007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5b742147-1702-46a6-ae0f-79ab34699fd0 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.529390 Aug 30 14:47:20.971318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 189/396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:20 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:21.991064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:21.993046 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:21.998360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:21.999231 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:21.999874 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:22.000633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:22.001290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:22.001936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:22.027988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:22.415344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:22.467118 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e6adb88e-8b47-4794-872b-e4260a1beffc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.479729 Aug 30 14:47:22.476512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 208/397] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:21 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:23.515604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:23.517222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:23.541816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:23.542718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:23.543449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:23.544408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:23.545050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:23.545631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:23.798759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1279365990", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "networks": [{"uuid": "78d4cb0d-146e-41ec-b460-39f9fdf90955"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:23.938519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] validate_networks() for [('78d4cb0d-146e-41ec-b460-39f9fdf90955', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:47:23.983094 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:24.045139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-35abe89c-ac56-46ae-aa87-4a3c87b8d26a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.525402 Aug 30 14:47:24.050154 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 190/398] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:23 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:24.569193 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:47:24.570078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:47:24.570738 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:47:24.571139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:47:24.571547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:47:24.581940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.582722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.585937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.586782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.587458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.587891 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.609000 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Getting quotas for project d29d875fc4d84f92801112d6d2accd13. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:47:24.614517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Getting quotas for user bf6b353833f14c3d819164e23374591e and project d29d875fc4d84f92801112d6d2accd13. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:47:24.636349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:47:24.641294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:47:24.700031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [c5b2c17c-3705-4d55-9979-5f13a858b508] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 14:47:25.087349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:25.089186 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:25.119745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.120243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.120695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.121599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.121872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.122301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.313558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:25.323122 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-546ca864-1602-4842-ade8-46120e46abc5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.250412 Aug 30 14:47:25.324083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 191/399] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:25 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:25.711807 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [c5b2c17c-3705-4d55-9979-5f13a858b508] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 38464. Aug 30 14:47:25.722322 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c3559761-d359-44e2-badd-56ca06e003d9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933046 Aug 30 14:47:25.723424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 209/400] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:47:25.742785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6282efa3-85e2-4935-adba-40c7c8c02291 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:25.743904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6282efa3-85e2-4935-adba-40c7c8c02291 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:25.846391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6282efa3-85e2-4935-adba-40c7c8c02291 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:25.865524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6282efa3-85e2-4935-adba-40c7c8c02291 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1219 microversion: 2.1 time: 0.130394 Aug 30 14:47:25.877143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 192/401] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:25 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:26.349098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:26.351623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:26.371679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.373265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.374392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.375988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.376830 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.377600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.648506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:26.658427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d8c17749-b3c9-4369-b89e-e30340d39d16 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.316898 Aug 30 14:47:26.659457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 210/402] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:26 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:26.890160 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:26.892547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:26.903755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.904684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.905436 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.906685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.907479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.910341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:27.021074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:27.033305 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b2c1e255-6e5d-46ea-88a1-6fafdb948f18 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1223 microversion: 2.1 time: 0.151154 Aug 30 14:47:27.034802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 193/403] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:26 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:27.689328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:27.691700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:27.704472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.705835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.706918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:27.709053 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.710380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.711452 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:28.050505 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:28.057781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:28.058494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:28.070830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:28.075240 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:28.075809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:28.076673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:28.080664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:28.081212 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:28.093382 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c6a6ecff-fb01-4924-b01f-5aace1c4df69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.411711 Aug 30 14:47:28.107186 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 211/404] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:27 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:28.236050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:28.242812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=92 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:28.254360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-eb907795-c8c1-4b39-93cf-d103cbc3d619 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1223 microversion: 2.1 time: 0.200496 Aug 30 14:47:28.261973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 194/405] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:28 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1223 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:29.124295 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:29.127341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:29.150061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.161979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.162842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.163887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.164629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.165268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.283353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:29.284344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:29.301556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.302550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.303557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.305111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.305899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.306540 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.416345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:29.426947 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7e3db39d-67d3-48b8-9c8e-e1cfc84f502d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1271 microversion: 2.1 time: 0.147537 Aug 30 14:47:29.429429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 195/406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:29 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:29.648270 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:29.668559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-597eed70-aac7-4136-b07c-1e85d01bb503 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.547855 Aug 30 14:47:29.670401 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 212/407] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:29 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:30.460888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:30.462230 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:30.475719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.476194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.477022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.477948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.478612 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.479214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.609708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:30.625668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2e3bd644-4333-4b58-9661-f2d2b4ce2c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1271 microversion: 2.1 time: 0.174898 Aug 30 14:47:30.627102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 196/408] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:30 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:30.706000 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:30.706913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:30.721959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.722460 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.722899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.723616 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.724308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.725098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.379737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:31.393721 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-446e350d-ea73-4857-afa4-9beeee630170 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1501 microversion: 2.1 time: 0.691228 Aug 30 14:47:31.404162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 213/409] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:30 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1501 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:31.418284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efaef797-07ed-4db7-b06e-be663eb85a18"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:31.420987 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.445520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.447097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.447779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.449096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.449835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.451189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.497521 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] HTTP exception thrown: Cannot 'attach_volume' instance ec5ebea7-409d-4e00-9a26-030000cdb28b while it is in vm_state rescued Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Request method failure captured: Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: POST /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b/os-volume_attachments HTTP/1.1 Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 74 Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJBt6DT6XPRSNgF4YQ20t2R5-A5QLe3R2nH0anCT7IqtSIz8tQpjuk4LmnHpdtyEsEO_qdxPf3NilU02EEdCojhWvVjaiNKiSaH6KqZIoN8b7AVnzUpmd46eyKonkhoItSCg-K3q20XuBM9AvACsqBJAcs13ti2fMwQYZYuvl7I5bM Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:47:31.499277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52028232fa7e4d808057e3e5512e6135", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 3398704b0dbc4af08e94b774a88851a4 Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {"volumeAttachment": {"volumeId": "efaef797-07ed-4db7-b06e-be663eb85a18"}} Aug 30 14:47:31.500921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Cannot 'attach_volume' instance ec5ebea7-409d-4e00-9a26-030000cdb28b while it is in vm_state rescued Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'server_id': 'ec5ebea7-409d-4e00-9a26-030000cdb28b', 'body': {'volumeAttachment': {'volumeId': 'efaef797-07ed-4db7-b06e-be663eb85a18'}}} Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ec5ebea7-409d-4e00-9a26-030000cdb28b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:47:31.501957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ec5ebea7-409d-4e00-9a26-030000cdb28b while it is in vm_state rescued Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:31.503315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:31.504451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:47:31.504451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:47:31.504451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ec5ebea7-409d-4e00-9a26-030000cdb28b while it is in vm_state rescued Aug 30 14:47:31.504451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.504451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Returning 409 to user: Cannot 'attach_volume' instance ec5ebea7-409d-4e00-9a26-030000cdb28b while it is in vm_state rescued {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:47:31.504451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ba06d9b6-92a4-41c1-a6e8-2c45581bbcbb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087025 Aug 30 14:47:31.504451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 197/410] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:47:31 2022] POST /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 14:47:31.511840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:31.512420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.529977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.530478 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.531005 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.531818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.532323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.533551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.648943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:31.650774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.665562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.667152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.668106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.668804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.669273 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.669699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.683526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-71a9d82b-7d5f-478d-a693-58be689cdf43 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b/action" status: 202 len: 0 microversion: 2.1 time: 0.176394 Aug 30 14:47:31.687640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 214/411] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:47:31 2022] POST /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:47:31.699916 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:31.700675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.720780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.720780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.720780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.722177 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.728349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.728349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:32.379926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:32.399754 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8589a657-6ea7-4ecc-b7e1-97829be3204b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1277 microversion: 2.1 time: 0.755545 Aug 30 14:47:32.401135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 198/412] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:31 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1277 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:32.713486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:32.722104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7f990b54-a967-44f7-89cf-e1b0f994cb03 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1509 microversion: 2.1 time: 1.032453 Aug 30 14:47:32.728269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 215/413] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:31 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1509 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:33.422233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:33.425468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:33.438549 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.444366 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.453614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.463288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.464322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.464924 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.743130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:33.743751 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:33.753212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.753715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.754154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.760273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.760796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.761286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:34.035283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:34.070886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-779e5a6d-9a09-4ccb-bddb-fa09e02f77b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.651061 Aug 30 14:47:34.097581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 199/414] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:33 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:34.228075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:34.248644 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c91f9736-0106-4177-b397-0be32a7f284d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1509 microversion: 2.1 time: 0.509472 Aug 30 14:47:34.251103 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 216/415] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:33 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1509 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:35.098265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:35.101510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:35.122860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.123644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.124342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.125591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.126377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.126948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.273405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:35.274968 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:35.277713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:35.279053 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:35.285842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.286473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.287237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.288293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.289032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.290173 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.474695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:35.485111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cb823c29-2e1c-4e5b-bd3b-cd0ca4149d6f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.395633 Aug 30 14:47:35.487745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 200/416] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:35 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:35.505832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-5c10a160-dc7f-4786-9226-7597799187ea req-95a1883d-3c4e-437a-8e2a-f34f557e956e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c605be08-2590-47c6-9197-2b7046cb3acf", "tag": "142062f8-bbe6-465f-94e5-cd5a916b5637"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:35.530945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5c10a160-dc7f-4786-9226-7597799187ea req-95a1883d-3c4e-437a-8e2a-f34f557e956e service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.532569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5c10a160-dc7f-4786-9226-7597799187ea req-95a1883d-3c4e-437a-8e2a-f34f557e956e service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.533232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5c10a160-dc7f-4786-9226-7597799187ea req-95a1883d-3c4e-437a-8e2a-f34f557e956e service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.554946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-5c10a160-dc7f-4786-9226-7597799187ea req-95a1883d-3c4e-437a-8e2a-f34f557e956e service nova] Creating event network-changed:142062f8-bbe6-465f-94e5-cd5a916b5637 for instance c605be08-2590-47c6-9197-2b7046cb3acf on hv-cinder-82880 Aug 30 14:47:35.561880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-5c10a160-dc7f-4786-9226-7597799187ea req-95a1883d-3c4e-437a-8e2a-f34f557e956e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065469 Aug 30 14:47:35.563460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 201/417] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:35.601085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:35.609289 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d6094135-3a2e-465d-9da8-e48544fd0ed5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1509 microversion: 2.1 time: 0.341373 Aug 30 14:47:35.618978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 217/418] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:35 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:36.505852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:36.516026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:36.517015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:36.524895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.525411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.526007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.526870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.527477 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.528088 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.631378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:36.634626 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:36.649216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.664347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.665145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.666288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.666965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.667555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.986050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:37.003510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-116e780e-7f86-4506-b899-0f38e93410c0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.492464 Aug 30 14:47:37.008140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 202/419] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:36 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:37.072964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:37.084095 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-24f0bb82-4cae-4872-bd0c-e145e890b05d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1509 microversion: 2.1 time: 0.458003 Aug 30 14:47:37.096309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 218/420] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:36 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:38.048449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:38.050128 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:38.059879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:38.060921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:38.061735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:38.062747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:38.063627 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:38.064294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:38.108849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:38.109858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:38.137125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:38.137534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:38.138092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:38.140061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:38.147603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:38.148248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:38.479804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:38.492540 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b4c5b67c-1159-4bfd-853c-da8003b00fcc tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.451830 Aug 30 14:47:38.493132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 203/421] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:38 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:38.619123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:38.633734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8aa527d8-337e-4e0b-a57d-036c448885ac tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1515 microversion: 2.1 time: 0.531343 Aug 30 14:47:38.634925 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 219/422] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:38 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1515 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:39.516180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:39.516729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:39.527843 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:39.528368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:39.528803 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:39.529522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:39.545146 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:39.545691 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:39.767736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:39.786772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-12afd2cb-1f93-483a-8ffb-2b7d5ce4e8c1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.275050 Aug 30 14:47:39.787813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 204/423] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:39 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:40.811142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:40.811796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:40.825688 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:40.826212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:40.826865 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:40.827788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:40.828500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:40.829088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:41.183067 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:41.194084 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d9e18ddc-3d04-4efa-9244-56489494c592 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.387915 Aug 30 14:47:41.209266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 220/424] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:40 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:41.714684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2414c5dc-109f-476b-88f7-6cce114ef85d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'create', calling method: .version_select at 0x7fe6a66bd1f0>, body: {"keypair": {"name": "tempest-keypair-1328059595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO18uQl3kaysmWcsBSnPl7ZUeYVRXABas70ptOqy+X0oELozDfoX6vzPQUYfAHqJknrvT1m5AUoy/hrn2x+5q++2ATIpLFakJyknbSUKfnyfTLRvbcxiedxae+nojN5Y4g=="}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:41.741368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-2414c5dc-109f-476b-88f7-6cce114ef85d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for project 52028232fa7e4d808057e3e5512e6135. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:47:41.747099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-2414c5dc-109f-476b-88f7-6cce114ef85d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for user 3398704b0dbc4af08e94b774a88851a4 and project 52028232fa7e4d808057e3e5512e6135. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:47:41.799543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2414c5dc-109f-476b-88f7-6cce114ef85d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090107 Aug 30 14:47:41.807977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 205/425] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:47:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:42.220329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:42.221792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:42.249158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:42.257140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:42.260604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:42.263121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:42.266132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:42.268339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:42.270272 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:43.037792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:43.072162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9a4bd666-a99e-43b3-b813-f340514b16db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.858789 Aug 30 14:47:43.076488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 221/426] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:42 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:44.100809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:44.102985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:44.125940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:44.126762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:44.128493 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:44.131726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:44.132977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:44.135553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:44.594981 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:44.611989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d40f86c7-5ac3-4813-a71d-17d4a8c23585 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.518292 Aug 30 14:47:44.615373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 206/427] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:44 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:45.184964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1935438745", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ebed3de8-2f6e-4966-9fa4-3b466a71b3b1"}], "security_groups": [{"name": "tempest-securitygroup--1972668080"}], "key_name": "tempest-keypair-1328059595", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:45.595403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] validate_networks() for [('ebed3de8-2f6e-4966-9fa4-3b466a71b3b1', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:47:45.637573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:45.638125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:45.653764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:45.657764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:45.658063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:45.658804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:45.659263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:45.659694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:46.028212 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:46.055063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c4dbdada-ad33-436d-bc34-a94af4783056 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.421721 Aug 30 14:47:46.057506 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 207/428] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:45 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:46.776966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:47:46.777653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:47:46.778636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:47:46.779386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:47:46.780232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:47:46.815154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:46.815729 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:46.816219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:46.817018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:46.821131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:46.824686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:46.862336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for project 52028232fa7e4d808057e3e5512e6135. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:47:46.869304 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Getting quotas for user 3398704b0dbc4af08e94b774a88851a4 and project 52028232fa7e4d808057e3e5512e6135. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:47:46.916512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:47:46.919367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:47:47.058395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-00439bae-5845-4cee-b702-c8f8c0e09320 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.879488 Aug 30 14:47:47.065272 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 222/429] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:47:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:47:47.072875 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-25664af4-a568-41bd-bb76-364ba8d3a2ab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:47.074733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-25664af4-a568-41bd-bb76-364ba8d3a2ab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:47.095820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:47.096792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:47.110612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:47.116205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:47.117036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:47.118605 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:47.119293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:47.119916 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:47.315183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-25664af4-a568-41bd-bb76-364ba8d3a2ab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:47.327798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-25664af4-a568-41bd-bb76-364ba8d3a2ab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1246 microversion: 2.1 time: 0.260000 Aug 30 14:47:47.340050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 208/430] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:47 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1246 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:47.514870 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:47.549543 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-05daf670-9199-4ee4-a179-8a9a4d9063cd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.469637 Aug 30 14:47:47.552341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 223/431] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:47 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:48.351856 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:48.352591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:48.355430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:48.383244 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:48.383847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:48.384524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:48.385463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:48.386088 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:48.386691 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:48.514121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:48.524693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-53fe0dca-563b-4794-9afe-dca7f9104adb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1298 microversion: 2.1 time: 0.177008 Aug 30 14:47:48.540742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 209/432] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:48 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1298 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:48.576221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:48.577547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:48.591106 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:48.591875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:48.592502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:48.593870 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:48.594526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:48.595158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:48.847795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:48.858234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-13b9fbee-e1fc-4ecd-bc64-16dc196754a1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.285896 Aug 30 14:47:48.858836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 224/433] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:48 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:49.569857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:49.579365 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:49.606302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:49.606519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:49.612665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:49.613533 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:49.619730 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-19f36276-c701-45cd-8021-264e58a8ed91 req-4c6a7fec-9edb-4650-a23b-ba38b8975d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c605be08-2590-47c6-9197-2b7046cb3acf", "name": "network-vif-plugged", "status": "completed", "tag": "142062f8-bbe6-465f-94e5-cd5a916b5637"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:49.630358 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:49.632696 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:49.637476 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-19f36276-c701-45cd-8021-264e58a8ed91 req-4c6a7fec-9edb-4650-a23b-ba38b8975d3d service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:49.642463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-19f36276-c701-45cd-8021-264e58a8ed91 req-4c6a7fec-9edb-4650-a23b-ba38b8975d3d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:49.643286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-19f36276-c701-45cd-8021-264e58a8ed91 req-4c6a7fec-9edb-4650-a23b-ba38b8975d3d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:49.662591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-19f36276-c701-45cd-8021-264e58a8ed91 req-4c6a7fec-9edb-4650-a23b-ba38b8975d3d service nova] Creating event network-vif-plugged:142062f8-bbe6-465f-94e5-cd5a916b5637 for instance c605be08-2590-47c6-9197-2b7046cb3acf on hv-cinder-82880 Aug 30 14:47:49.674339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-19f36276-c701-45cd-8021-264e58a8ed91 req-4c6a7fec-9edb-4650-a23b-ba38b8975d3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056449 Aug 30 14:47:49.681085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 225/434] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:47:49.882972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:49.890867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:49.894074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:49.909279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d68f9baa-3f68-485c-b8c4-a0162a8da078 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1316 microversion: 2.1 time: 0.350186 Aug 30 14:47:49.911538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:49.912980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 210/435] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:49 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:49.913867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:49.914489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:49.915463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:49.916151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:49.918032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:49.921546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:50.470552 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:50.485207 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5e7308fb-5939-4984-b2e8-6617c0b3387b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 0.599917 Aug 30 14:47:50.486178 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 226/436] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:49 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:50.934370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:50.935004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:50.946074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:50.950736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:50.951515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:50.955525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:50.956465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:50.957072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:51.199861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:51.219860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e752bcbf-77c8-4fdc-bbe7-20f078840431 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1304 microversion: 2.1 time: 0.289989 Aug 30 14:47:51.243661 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 211/437] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:50 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1304 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:51.510609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:51.525323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:51.548700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:51.549860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:51.550963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:51.556584 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:51.557500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:51.563603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:52.246520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:52.247159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:52.292040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:52.293447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:52.303413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:52.306827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:52.328813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:52.331473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:53.114757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:53.128733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-babd5785-0cd6-4817-abea-aac1c9335718 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1319 microversion: 2.1 time: 1.620476 Aug 30 14:47:53.129513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 227/438] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:51 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1319 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:53.410729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:53.485255 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1beb178c-6d11-41d1-8374-9e1d5a5bd82e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 1.240248 Aug 30 14:47:53.491314 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 212/439] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:52 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:54.168232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:54.169617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:54.179420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:54.185142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:54.185965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:54.187724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:54.188494 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:54.192248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:54.535656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:54.536932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:54.564494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:54.567785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:54.571683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:54.573304 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:54.577145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:54.585278 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:54.732868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:54.760555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5046f582-1913-41a1-adb6-cb86c613ed96 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1507 microversion: 2.1 time: 0.592765 Aug 30 14:47:54.764709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 228/440] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:54 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1507 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:55.215650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:55.251076 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-72f376fc-619e-458b-8813-fd0d433776c2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.714931 Aug 30 14:47:55.254779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 213/441] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:54 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:55.296629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-9e5d2732-bee8-4ffa-a0df-0a94161a407d req-15eefed7-a36d-481a-aa18-e479e13fdfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5552e35-b056-42a7-a699-e0f24a696704", "tag": "c2a653f7-0c72-4f59-add6-44e44654186f"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:55.326903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9e5d2732-bee8-4ffa-a0df-0a94161a407d req-15eefed7-a36d-481a-aa18-e479e13fdfe4 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:55.327400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9e5d2732-bee8-4ffa-a0df-0a94161a407d req-15eefed7-a36d-481a-aa18-e479e13fdfe4 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:55.327840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9e5d2732-bee8-4ffa-a0df-0a94161a407d req-15eefed7-a36d-481a-aa18-e479e13fdfe4 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:55.383901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-9e5d2732-bee8-4ffa-a0df-0a94161a407d req-15eefed7-a36d-481a-aa18-e479e13fdfe4 service nova] Creating event network-changed:c2a653f7-0c72-4f59-add6-44e44654186f for instance d5552e35-b056-42a7-a699-e0f24a696704 on hv-cinder-82880 Aug 30 14:47:55.407286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-9e5d2732-bee8-4ffa-a0df-0a94161a407d req-15eefed7-a36d-481a-aa18-e479e13fdfe4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112361 Aug 30 14:47:55.408727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 229/442] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:47:56.285896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:56.286915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:56.308110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:56.309288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:56.309990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:56.337417 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:56.339197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:56.342985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:56.389342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:56.759686 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:56.779784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3a770e19-94cb-43fe-ba25-924a809f0419 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.502250 Aug 30 14:47:56.796041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 214/443] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:56 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:57.833935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:57.836847 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:57.849894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:57.851750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:57.854285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:57.855804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:57.856527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:57.858050 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:57.858726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:57.859391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:58.257858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:58.266693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-977c5385-2b8d-46ac-a651-3688fc36e521 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.448140 Aug 30 14:47:58.271818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 230/444] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:57 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:59.293634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:59.311828 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:59.313065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:59.335513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:59.350098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:59.351342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:59.353797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:59.354135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:59.358819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:59.635176 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-91cb9135-18fa-4640-85fc-65819a777aeb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Action: 'create', calling method: .version_select at 0x7fe6a6514b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-757547522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQqcQqRiHSM++mZZGyrWn5ndli1x696TS3BYUoSe+KHpLjMIJKkSpervVcr1mR+A196d1wTpuInLb2qV2j3iFO+XdJ88zsUYN59mxspx3Ja+8187t8ptMyIo/wQ94EwtA=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:59.655534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-91cb9135-18fa-4640-85fc-65819a777aeb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Getting quotas for project 30338c95ad8d476b89bbec65ad188b2d. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:47:59.662282 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-91cb9135-18fa-4640-85fc-65819a777aeb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Getting quotas for user eb1aa3917d3d427e91f0805e5d6ab4eb and project 30338c95ad8d476b89bbec65ad188b2d. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:47:59.700506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-91cb9135-18fa-4640-85fc-65819a777aeb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.069274 Aug 30 14:47:59.702091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 231/445] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:47:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:47:59.884520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2019537581", "imageRef": "081e5c4f-e971-42da-99e8-5318079afacf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-757547522", "networks": [{"uuid": "fdec9a09-0a27-4947-b7f6-9ed77a114227"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:59.989343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] validate_networks() for [('fdec9a09-0a27-4947-b7f6-9ed77a114227', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:48:00.237986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:00.257893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f2a1bdb2-1d46-40b1-a711-e166646f97ba tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.965038 Aug 30 14:48:00.278144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 215/446] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:59 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:00.726420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e7011097-7c26-41f2-9aed-c308aeca315f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Action: 'create', calling method: .version_select at 0x7fe6a6593310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-495216325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+5EX0tzjgikn0BFpXlVHICZOmS7mQAjrIrFvBXVoOI7oXCLKN4XhPt3+ibPa/RJtYIdxzWeuTrJh5QJN3qpB/2qb0VENQfSvNP6RkrryCe/ng5h7VmS/uOH3A4vHYKyA=="}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:00.745583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-e7011097-7c26-41f2-9aed-c308aeca315f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:48:00.752074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-e7011097-7c26-41f2-9aed-c308aeca315f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for user 06ab23cfa18e47c9871c6f451b871ef2 and project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:48:00.787210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e7011097-7c26-41f2-9aed-c308aeca315f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.356343 Aug 30 14:48:00.796132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 216/447] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:48:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:00.971612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:48:00.973742 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:48:00.974656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:48:00.975401 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:48:00.975967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:48:01.001941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:01.004078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:01.005044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:01.006604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:01.007536 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:01.008278 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:01.038653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Getting quotas for project 30338c95ad8d476b89bbec65ad188b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:48:01.049517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Getting quotas for user eb1aa3917d3d427e91f0805e5d6ab4eb and project 30338c95ad8d476b89bbec65ad188b2d. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:48:01.079506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:48:01.084345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='081e5c4f-e971-42da-99e8-5318079afacf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:48:01.195756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aadfdf67-dc9d-4c74-8115-27cada3e0506 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315440 Aug 30 14:48:01.208193 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 232/448] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:47:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:48:01.217035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bc8a7b05-fb43-42c2-848a-a4b7b608663b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:01.217844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bc8a7b05-fb43-42c2-848a-a4b7b608663b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:01.302917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:01.306670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:01.317276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:01.318051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:01.318703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:01.320359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:01.321146 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:01.321735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:01.361400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bc8a7b05-fb43-42c2-848a-a4b7b608663b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:01.431870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bc8a7b05-fb43-42c2-848a-a4b7b608663b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1258 microversion: 2.1 time: 0.219132 Aug 30 14:48:01.436646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 217/449] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:01 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:01.738161 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:01.766813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-81badea7-f70c-4258-ba14-bab768dc7fbf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.473569 Aug 30 14:48:01.768724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 233/450] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:01 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:02.475684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:02.477321 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:02.487275 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:02.492125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:02.492125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:02.492646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:02.493273 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:02.493712 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:02.603026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:02.622063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-31ebe6f9-864b-48fc-8d74-010466fcbbcf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1254 microversion: 2.1 time: 0.152725 Aug 30 14:48:02.625146 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 218/451] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:02 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1254 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:02.823089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:02.824281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:02.837740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:02.838707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:02.844996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:02.847784 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:02.849424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:02.850548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:03.075093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:03.084868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d7b05260-d0ff-4a38-8020-e10d38012780 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.286470 Aug 30 14:48:03.086002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 234/452] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:02 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:03.654209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:03.658533 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:03.682824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:03.684532 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:03.685631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:03.687280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:03.688945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:03.690356 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:03.809234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-ee7e107e-d3b8-46b1-9b78-69299bf493ae req-062b3848-a9c6-4e7b-8a73-52ce70ceab5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5552e35-b056-42a7-a699-e0f24a696704", "name": "network-vif-plugged", "status": "completed", "tag": "c2a653f7-0c72-4f59-add6-44e44654186f"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:03.835574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ee7e107e-d3b8-46b1-9b78-69299bf493ae req-062b3848-a9c6-4e7b-8a73-52ce70ceab5c service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:03.838182 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ee7e107e-d3b8-46b1-9b78-69299bf493ae req-062b3848-a9c6-4e7b-8a73-52ce70ceab5c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:03.839130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-ee7e107e-d3b8-46b1-9b78-69299bf493ae req-062b3848-a9c6-4e7b-8a73-52ce70ceab5c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:03.866206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-ee7e107e-d3b8-46b1-9b78-69299bf493ae req-062b3848-a9c6-4e7b-8a73-52ce70ceab5c service nova] Creating event network-vif-plugged:c2a653f7-0c72-4f59-add6-44e44654186f for instance d5552e35-b056-42a7-a699-e0f24a696704 on hv-cinder-82880 Aug 30 14:48:03.879081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:03.879915 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-ee7e107e-d3b8-46b1-9b78-69299bf493ae req-062b3848-a9c6-4e7b-8a73-52ce70ceab5c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077251 Aug 30 14:48:03.881195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 235/453] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:03.895975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e6f1c099-563e-4b73-9957-31a01b2a222c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1318 microversion: 2.1 time: 0.251908 Aug 30 14:48:03.897139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 219/454] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:03 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:04.113178 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:04.122614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:04.141620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:04.145109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:04.145567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:04.146306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:04.153208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:04.154008 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:04.533410 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:04.568337 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-03e6204b-9cb6-4684-b228-56c8738d78fd tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.461507 Aug 30 14:48:04.570005 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 236/455] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:04 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:04.939527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:04.940541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:04.955879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:04.956973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:04.957617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:04.959046 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:04.960055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:04.960825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:05.173688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:05.224243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b11340f2-10dc-44fd-b7e6-db4ef422b53f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1316 microversion: 2.1 time: 0.292034 Aug 30 14:48:05.226292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 220/456] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:04 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:05.614559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:05.626551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:05.640603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:05.645249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:05.657007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:05.658115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:05.659209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:05.659762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:06.012693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:06.023343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e8e8922c-e739-4b03-88be-85a04941e9f8 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.415816 Aug 30 14:48:06.024312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 237/457] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:05 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:06.253145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:06.255832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:06.283192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:06.284084 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:06.285632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:06.287184 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:06.288844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:06.289502 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:06.687049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:06.718219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1fa165e4-4867-4fa2-bd81-96035a922e17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.470623 Aug 30 14:48:06.719505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 221/458] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:06 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:07.062324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:07.063428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:07.094420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:07.097049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:07.100353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:07.101265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:07.101937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:07.107450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:07.428430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:07.454435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-448e9c10-fa6e-41bc-bda4-8962d016c6f4 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.400226 Aug 30 14:48:07.455223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 238/459] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:07 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:07.758354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:07.759080 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:07.768676 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:07.769485 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:07.770110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:07.771180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:07.774429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:07.774429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:08.054420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:08.088028 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-de9d3ad8-2db6-4404-87f5-ebf56d716df1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.334776 Aug 30 14:48:08.103009 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 222/460] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:07 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:08.495264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:08.498177 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:08.520756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:08.521895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:08.522850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:08.524485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:08.526101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:08.527201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:08.844859 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:08.860734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-97474357-382d-415c-a0fe-6d65e9407ecf tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.377138 Aug 30 14:48:08.861690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 239/461] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:08 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:09.126629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:09.127332 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:09.136459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.137096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.137744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.140909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.141507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.142713 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.421562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:09.431669 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e76b5b07-00ba-4ba3-8e1b-8f58f0ba7544 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.310434 Aug 30 14:48:09.432288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 223/462] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:09 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:09.895937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:09.896994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:09.904921 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.905555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.906095 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.906961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.907603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.908272 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.087612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:10.102138 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c0fac614-c22d-445a-8e92-a601907143a7 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.210791 Aug 30 14:48:10.103578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 240/463] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:09 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:10.462313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:10.463642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:10.480632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.496226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.497054 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.497824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.498294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.498731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.685046 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:10.704459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-319ab496-4bfa-4268-bfea-3b99e7114bb1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.251511 Aug 30 14:48:10.705518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 224/464] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:10 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:11.130614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:11.131603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:11.134055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:11.135066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=10 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:11.144447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.145405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.146259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.147601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.148344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.149031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.307799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:11.316464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5abe3f26-e26e-4aac-bbdf-34ea670514ee tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.189835 Aug 30 14:48:11.317024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 241/465] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:11 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:11.734888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:11.735650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:11.737586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:11.746315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.746817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.747286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.748098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.748490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.748911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.948312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:11.964530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b1b64a69-e2df-4ac7-b464-100aaf6cda8e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.233472 Aug 30 14:48:11.978747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 225/466] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:11 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:12.339462 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:12.340482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:12.349574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:12.351824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:12.352532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:12.353368 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:12.353851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:12.354307 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:12.539330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:12.553466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-98fc0f02-cafe-46e9-83eb-439c574e5d91 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.217706 Aug 30 14:48:12.554477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 242/467] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:12 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:12.992232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:12.994496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:13.014103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.015322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.016312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.017787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.018914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.020189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.263832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:13.272807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7086cdf0-8319-4418-b087-7b7ad60b288e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.284981 Aug 30 14:48:13.273814 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 226/468] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:12 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:13.597061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:13.599188 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:13.611277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:13.616276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.617297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.618130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.619220 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.619938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.620617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.871491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:13.879907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-065112d3-c185-486a-b28d-02e133b514e2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.290690 Aug 30 14:48:13.880545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 243/469] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:13 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:14.302794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:14.305054 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:14.317803 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.318595 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.319082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:14.319899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.320498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.320950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:14.492232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:14.511193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ceee9c54-a507-4fa0-882f-03c274d13312 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.214961 Aug 30 14:48:14.512020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 227/470] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:14 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:14.906326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:14.906967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:14.914313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.914824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.915264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:14.915990 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.916482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.916907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.122690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:15.131962 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3251fd2c-9e6a-4f50-a78f-f9c0e60dcbce tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.229844 Aug 30 14:48:15.132603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 244/471] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:14 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:15.537773 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:15.539580 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:15.548524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.549430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.550035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.550731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.551224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.551702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.588205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:15.588666 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:15.595489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.595978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.596446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.597258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.597740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.598161 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.634645 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2d43a573-e9a6-4d37-8696-ae69e2c415a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/ips" status: 200 len: 146 microversion: 2.1 time: 0.050666 Aug 30 14:48:15.635591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 245/472] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:48:15 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:15.978948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:15.992234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-924db41a-da23-4f3b-889a-b75a8672f942 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.457956 Aug 30 14:48:15.992926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 228/473] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:15 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:16.158923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:16.162014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:16.176512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.178653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.180128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:16.182131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.182984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.184608 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:16.222624 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:16.359420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:16.368378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-95f56ffe-dbe8-4b7b-9ace-3923123e6ade tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.217455 Aug 30 14:48:16.373414 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 246/474] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:16 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:16.432341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:16.433069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:16.443830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.445389 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.445836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:16.446566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.447020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.447514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:16.475976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-15439255-f219-40ca-90f4-e91324e21b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/ips" status: 200 len: 151 microversion: 2.20 time: 0.048429 Aug 30 14:48:16.477249 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 229/475] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Aug 30 14:48:16 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:17.017026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:17.017637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:17.024416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:17.024906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:17.025335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:17.026032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:17.026481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:17.026900 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:17.193152 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:17.203519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aeffa512-956f-4e2e-b835-89e675f9ee17 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.190377 Aug 30 14:48:17.204158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 247/476] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:17 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:17.395708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:17.396661 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:17.411329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:17.412243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:17.425660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:17.428872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:17.429701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:17.431546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:17.628895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:17.645287 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e804d318-f34e-4e07-9093-06fb2ed96891 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.253799 Aug 30 14:48:17.646397 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 230/477] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:17 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:18.233522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:18.234933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:18.243331 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.243948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.244658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.245592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.246128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.246645 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.429326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:18.437968 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5e252b86-10a2-4d4d-b1f7-9094d96e13c1 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.208360 Aug 30 14:48:18.438568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 248/478] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:18 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:18.677340 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:18.678624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:18.680522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:18.688265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.689083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.689508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.690444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.690925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.691324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.775030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:18.776154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:18.785179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.786065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.786714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.787708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.788419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.789145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.817378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lazy-loading 'flavor' on Instance uuid 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:48:18.890521 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:18.900951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b592e872-ce97-4161-938a-1af4e8599ecb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.227518 Aug 30 14:48:18.902146 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 231/479] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:18 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:19.043768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d8158e6-fdff-4497-82a0-c698e073079d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/action" status: 202 len: 0 microversion: 2.20 time: 0.274250 Aug 30 14:48:19.044390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 249/480] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 14:48:18 2022] POST /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 14:48:19.054249 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:19.054932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:19.062789 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.063288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.063724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.064501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.064954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.065673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.227248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:19.236394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:19.237878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:19.239109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-29e78762-e861-42d6-9820-a68e23fbd3c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.189489 Aug 30 14:48:19.239675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 232/481] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:19 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:19.462686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:19.463674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:19.472026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.472657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.473229 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.474094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.474708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.475373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.639283 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:19.647710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-35b717c5-c74b-4937-95a2-e1939fadf574 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.190248 Aug 30 14:48:19.648321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 250/482] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:19 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:19.923079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:19.923675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:19.930905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.931386 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.931823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.932564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.933006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.933779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.950419 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:20.084748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:20.093159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-72801d5f-8ff6-43e7-8934-9a6e36409ddc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.174464 Aug 30 14:48:20.093631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 233/483] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:19 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:20.263861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:20.264458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:20.270772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.271248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.271667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.272376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.272815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.273226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.420365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:20.429075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:20.430498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:20.431750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a2b8ea78-d03d-4395-a19f-56f4d3e07c46 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.171993 Aug 30 14:48:20.432339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 251/484] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:20 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:20.668886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:20.669496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:20.675971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.676482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.676905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.677595 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.678036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.678739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.828147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:20.836968 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-70ad043a-15fe-453e-b614-b09243d6ccf5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.171921 Aug 30 14:48:20.837549 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 234/485] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:20 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:21.114693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:21.115579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:21.122064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.122554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.122986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.123681 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.124167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.124582 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.273450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:21.281517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-43d09108-d5ed-4251-8dd5-1744082f2399 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.170882 Aug 30 14:48:21.282078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 252/486] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:21 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:21.458191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:21.459204 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:21.471140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.472022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.472839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.473896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.474505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.475096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.615291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:21.624342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:21.625805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:21.626958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8319a98b-acbd-42ab-b6a1-2b93ddd1e6ee tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.175677 Aug 30 14:48:21.629074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 235/487] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:21 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:21.759228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55b113c9-579d-430c-a926-c1f03616a095"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:21.762240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:21.768885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.769369 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.769797 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.770495 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.770935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.771347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.866709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:21.867553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:21.874248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.874734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.875311 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.875900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.876378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.876792 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.017099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:22.025518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-77351ba9-a704-4cac-9750-b37a5a6294ae tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.163069 Aug 30 14:48:22.026076 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 236/488] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:21 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:22.312918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:22.313907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:22.321659 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.322167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.322591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.323289 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.323728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.324235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.491773 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:22.501460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-59f9e615-bf28-4123-9ef2-a691861f5af6 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.201215 Aug 30 14:48:22.501959 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 237/489] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:22 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:22.651449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:22.652088 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:22.658581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.659057 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.659475 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.660201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.660644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.661055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.813053 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:22.823328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:22.825069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:22.826414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b7e8122d-b0b8-41fa-a97e-cfdd4d18afc7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.179102 Aug 30 14:48:22.830116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 238/490] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:22 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:48:23.047728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:23.048284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:23.055055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.055518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.055945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.056829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.057281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.057702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.204721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:23.213782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-62cca5c1-582f-469b-85ef-a44a21edcc5c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.170183 Aug 30 14:48:23.213782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 239/491] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:23 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:23.523066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:23.523830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:23.531254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.531861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.532323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.533035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.533486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.533908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.690750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:23.698851 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9a73552f-b087-4f03-93f9-3a56a46b2b4b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.179791 Aug 30 14:48:23.699418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 240/492] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:23 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:23.849880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:23.850618 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:23.857505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.857881 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.858324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.859025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.859473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.859888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.005811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:24.014561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:24.016021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:24.017238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3110ff8a-a030-4a48-a1c4-9d4113c0af70 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.171514 Aug 30 14:48:24.017797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 241/493] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:23 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:24.235127 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:24.235727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:24.242153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.242630 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.243051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.243776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.244255 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.244669 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.389370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:24.397727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-18967a15-6ff3-484b-a88f-46d47133ae3f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.166195 Aug 30 14:48:24.398561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 242/494] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:24 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:24.719724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:24.720554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:24.727941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.728534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.729028 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.729738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.730179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.730586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.878139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:24.887067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-887cbd49-ba1f-40c8-8d94-14afdf103cff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.171420 Aug 30 14:48:24.887564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 243/495] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:24 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:25.058862 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:25.059462 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:25.066029 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.066879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.067308 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.068027 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.068443 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.068905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.246035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:25.256769 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:25.258280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:25.259493 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e6584a45-0da2-4728-9c74-895c2aa20529 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.204929 Aug 30 14:48:25.260052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 244/496] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:25 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:25.419352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:25.419911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:25.426883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.427371 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.427798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.428634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.429079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.429494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.578632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:25.588067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-521f3b42-5f77-4c54-b766-56cb970e2073 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.172640 Aug 30 14:48:25.588675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 245/497] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:25 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:25.915335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:25.916057 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:25.922857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.923333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.923757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.924493 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.924933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.925347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.093835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:26.102697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bb214294-5931-4e05-a44f-d5d2640e9de1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1372 microversion: 2.1 time: 0.191545 Aug 30 14:48:26.103575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 246/498] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:25 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:26.285384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:26.285979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:26.292925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.293420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.293877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.294576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.295022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.295438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.546298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-407e7a37-1693-471a-84b3-7a131110c391 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.789918 Aug 30 14:48:26.547880 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 253/499] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:48:21 2022] POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-volume_attachments => generated 194 bytes in 4795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:26.617889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:26.621837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:26.622573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:26.641810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.643036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:26.644583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.645014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.645750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.646191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.647500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:26.648257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.650424 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6aa4423b-2b92-4719-882d-8a482b85b421 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.369003 Aug 30 14:48:26.662777 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 247/500] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:26 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:48:26.977657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:26.989639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e038aeb6-91b2-4131-aff7-e1eff7a2baaf tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.383920 Aug 30 14:48:26.991098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 254/501] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:26 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:27.054461 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-311ef85f-0897-41a4-9ba6-5b0a1e017e9d req-763b2c79-f35f-456d-8ba9-20385f2f87b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e57929-37de-4ea1-b61a-01b83a906ad1", "tag": "649219cb-9d47-46d0-bb79-dbd9ce7a2960"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:27.065031 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-311ef85f-0897-41a4-9ba6-5b0a1e017e9d req-763b2c79-f35f-456d-8ba9-20385f2f87b6 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.065422 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-311ef85f-0897-41a4-9ba6-5b0a1e017e9d req-763b2c79-f35f-456d-8ba9-20385f2f87b6 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.065818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-311ef85f-0897-41a4-9ba6-5b0a1e017e9d req-763b2c79-f35f-456d-8ba9-20385f2f87b6 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.077362 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-311ef85f-0897-41a4-9ba6-5b0a1e017e9d req-763b2c79-f35f-456d-8ba9-20385f2f87b6 service nova] Creating event network-changed:649219cb-9d47-46d0-bb79-dbd9ce7a2960 for instance a8e57929-37de-4ea1-b61a-01b83a906ad1 on hv-cinder-82880 Aug 30 14:48:27.082372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-311ef85f-0897-41a4-9ba6-5b0a1e017e9d req-763b2c79-f35f-456d-8ba9-20385f2f87b6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031857 Aug 30 14:48:27.082940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 248/502] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:48:27.124040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:27.124646 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:27.130701 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.131247 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.131670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.132399 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.132813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.133223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.270731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:27.279555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ac8a6cc6-63e1-40ea-a4bb-4b556db77512 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1565 microversion: 2.1 time: 0.159504 Aug 30 14:48:27.280227 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 255/503] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:27 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:27.304689 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:27.305272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:27.314003 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.314503 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.314936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.315708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.316096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.316575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.411662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-81085251-9141-45a2-8da7-cc3f0ad31e78 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111686 Aug 30 14:48:27.412538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 249/504] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:48:27 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:27.681647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:27.683308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:27.689966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.690444 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.690866 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.691585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.692030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.692442 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:28.011606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:28.012418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:28.019654 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:28.020176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:28.020806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:28.021698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:28.022205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:28.022801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:28.340786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:28.349485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:28.351299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:28.352696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-434eea21-6fcd-45eb-975e-d4f94d2c09ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.675404 Aug 30 14:48:28.353260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 256/505] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:27 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:48:28.798105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:28.806302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ab900385-ec0b-4b2e-be1f-7d991b15b744 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.798690 Aug 30 14:48:28.807322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 250/506] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:28 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:29.377875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:29.378448 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:29.385204 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.385686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.386114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.386809 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.387264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.387675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.581219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-512f7752-bb68-451f-8def-ff5a7c005f71 req-c858771a-66ff-4806-889a-106fd441587b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5552e35-b056-42a7-a699-e0f24a696704", "tag": "c2a653f7-0c72-4f59-add6-44e44654186f"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:29.592061 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-512f7752-bb68-451f-8def-ff5a7c005f71 req-c858771a-66ff-4806-889a-106fd441587b service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.592819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-512f7752-bb68-451f-8def-ff5a7c005f71 req-c858771a-66ff-4806-889a-106fd441587b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.593240 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-512f7752-bb68-451f-8def-ff5a7c005f71 req-c858771a-66ff-4806-889a-106fd441587b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.596190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:29.599557 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:29.606727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-512f7752-bb68-451f-8def-ff5a7c005f71 req-c858771a-66ff-4806-889a-106fd441587b service nova] Creating event network-changed:c2a653f7-0c72-4f59-add6-44e44654186f for instance d5552e35-b056-42a7-a699-e0f24a696704 on hv-cinder-82880 Aug 30 14:48:29.609669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:29.612065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-512f7752-bb68-451f-8def-ff5a7c005f71 req-c858771a-66ff-4806-889a-106fd441587b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034690 Aug 30 14:48:29.612418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:29.612647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 251/507] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:48:29.613579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7f5fea02-8e80-44fb-846e-32f04d8814ef tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.241145 Aug 30 14:48:29.614117 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 257/508] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:29 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:29.829793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:29.830541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:29.838541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.839770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.840245 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.841636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.841636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.841853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:30.161970 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:30.170497 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-362b8aa0-a017-4de8-9db2-aa378fa24707 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.344863 Aug 30 14:48:30.171153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 252/509] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:29 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:30.636609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:30.637235 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:30.647140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:30.647731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:30.648153 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:30.648877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:30.649336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:30.649768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:30.804768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:30.814271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:30.815691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:30.817084 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ff085f48-c795-44d0-9f6f-a05d67c3aa74 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.184649 Aug 30 14:48:30.817675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 258/510] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:30 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:31.192766 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:31.193400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:31.200848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.201326 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.201755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.202453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.202892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.203301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.355323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:31.363405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-35d7900d-3043-4c7f-8b45-2556a5c0e743 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.174511 Aug 30 14:48:31.364020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 253/511] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:31 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:31.840094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:31.840662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:31.847842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.848359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.848785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.849491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.849932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.850351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.871014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:32.006041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:32.015245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:32.016695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:32.017869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-466d3bcd-fe55-4752-a570-761bb726cf73 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.181955 Aug 30 14:48:32.018426 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 259/512] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:31 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:32.385915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:32.386568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:32.393444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:32.393917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:32.394334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:32.395016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:32.395448 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:32.395856 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:32.528106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:32.536504 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f58ef4d4-5e01-4a4d-b784-338ea3e83cce tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.154507 Aug 30 14:48:32.537108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 254/513] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:32 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:33.045436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:33.046672 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:33.056138 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.056622 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.057052 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.057751 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.058559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.059127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.232573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:33.241563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:33.243117 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:33.244314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bd20ab6f-47a3-4595-ad4f-1d022e2a6cd8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.205782 Aug 30 14:48:33.244915 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 260/514] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:33 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:33.558776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:33.559331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:33.566840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.567335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.567786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.568527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.568967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.569494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.709121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:33.717219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3f5ba9ee-b032-4b61-9ac7-dd5043dcc862 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.163349 Aug 30 14:48:33.717779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 255/515] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:33 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:34.273043 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:34.273688 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:34.280457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.280936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.281360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.282058 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.282496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.282913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.427830 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:34.437092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:34.438542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:34.439720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-07eed51c-01f1-406b-9339-c48da8c2362a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.170747 Aug 30 14:48:34.440363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 261/516] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:34 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:34.738774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:34.739357 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:34.746861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.747457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.747888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.748623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.749062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.749474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.898736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:34.906972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cd727ce5-862e-4c63-b768-ce21f8fa6901 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.172277 Aug 30 14:48:34.907570 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 256/517] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:34 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:35.463693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:35.464291 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:35.471387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.471970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.472434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:35.473205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.473745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.474164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:35.617170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:35.625743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:35.627302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:35.628609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c2d8e981-624b-459a-ad2f-97c4b7436bc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.169175 Aug 30 14:48:35.629155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 262/518] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:35 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:35.929426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:35.930097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:35.940050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.940519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.940974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:35.941684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.942129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.942566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:36.095515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:36.111118 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-eb9b5e8f-c248-4bad-9309-1a8ea9ac6b16 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.185263 Aug 30 14:48:36.112077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 257/519] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:35 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:36.651834 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:36.652638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:36.659940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:36.660478 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:36.660932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:36.661641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:36.662088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:36.662514 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:36.819835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:36.832678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:36.834319 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:36.835933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bd4c8938-9219-461d-bf06-9179922e3d11 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.188473 Aug 30 14:48:36.836586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 263/520] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:36 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:37.137834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:37.140875 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:37.152215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.152569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.152899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.153606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.154249 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.154602 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.304968 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:37.313238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f62ab057-e4fa-4f41-a131-35294ebee6e4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.182877 Aug 30 14:48:37.313804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 258/521] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:37 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:37.365957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f36a0056-bded-4f40-8018-cb5ddf7de634 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:37.372812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f36a0056-bded-4f40-8018-cb5ddf7de634 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.373323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f36a0056-bded-4f40-8018-cb5ddf7de634 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.373821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f36a0056-bded-4f40-8018-cb5ddf7de634 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.439758 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f36a0056-bded-4f40-8018-cb5ddf7de634 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Going to try to stop instance {{(pid=127177) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 14:48:37.495551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f36a0056-bded-4f40-8018-cb5ddf7de634 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action" status: 202 len: 0 microversion: 2.1 time: 0.133327 Aug 30 14:48:37.496458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 264/522] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:48:37 2022] POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:48:37.498986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3797307-6eb5-42b5-83f0-35558703e81b", "device": "/dev/sdb"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:37.502176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:37.509210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.509672 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.510103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.510743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:37.510900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.511263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.511528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:37.511787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.518883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.519463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.519902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.520642 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.521112 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.521536 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.685625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:37.698842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-adc476e4-2b9b-4a3e-baf0-830dc54ca295 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.193041 Aug 30 14:48:37.699550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 265/523] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:37 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:37.863281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:37.863901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:37.870858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.871332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.871774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.872528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.872986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.873418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.058319 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:38.069245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:38.071225 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:38.072463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a0a788c8-02bf-40eb-a7a9-91d1112ff5ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.213218 Aug 30 14:48:38.080949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 266/524] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:37 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:38.098415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f643c43c-aa1a-4f3e-95d6-cf90a15e0c29 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "POST /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.603470 Aug 30 14:48:38.099201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 259/525] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:48:37 2022] POST /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf/os-volume_attachments => generated 194 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:48:38.129458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-13f1b790-90fd-41f4-a5f1-afb1b5244fcb req-63e783d0-c919-4228-b49a-984caf072671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e57929-37de-4ea1-b61a-01b83a906ad1", "name": "network-vif-plugged", "status": "completed", "tag": "649219cb-9d47-46d0-bb79-dbd9ce7a2960"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:38.142126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-13f1b790-90fd-41f4-a5f1-afb1b5244fcb req-63e783d0-c919-4228-b49a-984caf072671 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.142729 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-13f1b790-90fd-41f4-a5f1-afb1b5244fcb req-63e783d0-c919-4228-b49a-984caf072671 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.143162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-13f1b790-90fd-41f4-a5f1-afb1b5244fcb req-63e783d0-c919-4228-b49a-984caf072671 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.156986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-13f1b790-90fd-41f4-a5f1-afb1b5244fcb req-63e783d0-c919-4228-b49a-984caf072671 service nova] Creating event network-vif-plugged:649219cb-9d47-46d0-bb79-dbd9ce7a2960 for instance a8e57929-37de-4ea1-b61a-01b83a906ad1 on hv-cinder-82880 Aug 30 14:48:38.175943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-13f1b790-90fd-41f4-a5f1-afb1b5244fcb req-63e783d0-c919-4228-b49a-984caf072671 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050754 Aug 30 14:48:38.176591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 267/526] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:38.343173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:38.343882 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:38.351891 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.352420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.352854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.353572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.354023 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.354445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.478492 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1021042445", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-495216325", "security_groups": [{"name": "tempest-secgroup-smoke-1433722321"}], "block_device_mapping_v2": [{"uuid": "dfcd8e6f-c53c-4553-8b23-dc7c0d5f0b96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47a984e3-6912-4cff-bbe4-e504a54d421e"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:38.572100 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:38.580300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-055cabfb-d8d3-42be-b584-6e5cf9936b59 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.242067 Aug 30 14:48:38.580953 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 260/527] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:38 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:38.619104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] validate_networks() for [('47a984e3-6912-4cff-bbe4-e504a54d421e', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:48:38.723350 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:38.723905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:38.730813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.731293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.731717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.732845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.733483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.733954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.964936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:38.973576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7adef9b5-b0da-439c-852a-07af72936f76 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.254188 Aug 30 14:48:38.973929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 261/528] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:38 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:39.077683 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:48:39.078203 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:48:39.078575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:48:39.078997 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:48:39.079397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:48:39.088934 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.089412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.089864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.090580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.091018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.091425 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.096709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:39.097312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:39.103963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.104477 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.104941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.105686 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.106131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.106571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.110477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:48:39.114673 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for user 06ab23cfa18e47c9871c6f451b871ef2 and project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:48:39.188622 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:48:39.190544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dfcd8e6f-c53c-4553-8b23-dc7c0d5f0b96',volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:48:39.250828 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:39.261268 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:39.262654 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:39.263894 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4e3fd45c-8ba8-47f1-bccc-7f07eb32c3df tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.171160 Aug 30 14:48:39.264506 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 262/529] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:39 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:39.346073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4a45a6ca-696b-4f3c-bf3a-4b6785ea2605 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.873518 Aug 30 14:48:39.346728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 268/530] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:48:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:48:39.366763 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0b0ea856-da55-4075-ab2a-9e05130c2060 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:39.367837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0b0ea856-da55-4075-ab2a-9e05130c2060 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:39.455236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0b0ea856-da55-4075-ab2a-9e05130c2060 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:39.464545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0b0ea856-da55-4075-ab2a-9e05130c2060 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1094 microversion: 2.1 time: 0.104780 Aug 30 14:48:39.465212 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 263/531] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:39 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:39.606277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:39.607205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:39.614436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.615116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.615670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.617062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.617671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.618250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.776850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:39.787677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e4621fa6-a706-4028-94e9-b2d6df3da8c4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.185256 Aug 30 14:48:39.788599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 269/532] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:39 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:39.996981 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:39.997599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:40.004082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.004571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.005002 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.005697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.006140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.006717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.155055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:40.163809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f00f094d-5f11-4105-a7d5-1c436af298ee tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.172721 Aug 30 14:48:40.164414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 264/533] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:39 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:40.287069 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:40.287676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:40.294852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.295366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.295783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.296514 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.296962 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.297366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.449373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:40.458129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:40.459535 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:40.460788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9caa8cca-77e6-4c93-96fd-91ac718e4b92 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.177711 Aug 30 14:48:40.461362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 270/534] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:40 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:40.485541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:40.486134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:40.493175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.493656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.494083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.494809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.495252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.495671 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.560993 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:40.569697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3ed7dafa-c664-4185-8d6f-0e64b3f4af43 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1136 microversion: 2.1 time: 0.087918 Aug 30 14:48:40.570289 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 265/535] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:40 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:40.816222 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:40.816831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:40.824539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.825025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.825605 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.826304 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.826749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.827164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.996935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:41.007391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4adc1f1e-344e-4db5-9353-82fa6ae541a4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1358 microversion: 2.1 time: 0.195014 Aug 30 14:48:41.008180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 271/536] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:40 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:41.185862 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:41.186486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:41.192666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.193143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.193569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.194409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.194915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.195326 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.342839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:41.352074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2fde9941-8ac2-4d62-bed3-f942bf89b018 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.170406 Aug 30 14:48:41.352636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 266/537] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:41 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:41.483063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:41.483658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:41.489908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.490373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.490856 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.491877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.492377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.492796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.593331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:41.594747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:41.601563 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.602012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.602621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.603456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.604069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.604649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.645334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:41.654419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:41.655837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:41.657045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c4565064-0688-42be-9224-f4458e906974 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.178043 Aug 30 14:48:41.657604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 272/538] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:41 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:41.681736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:41.690108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-75feac26-8bb5-49bc-852f-82b1a04af4d3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1192 microversion: 2.1 time: 0.100548 Aug 30 14:48:41.690693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 267/539] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:41 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:42.029171 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.029787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.040781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.041278 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.041758 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.042481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.043206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.043724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.225686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.237023 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-87a48631-3cb7-4aaa-bdbc-94d8c39769eb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1548 microversion: 2.1 time: 0.210307 Aug 30 14:48:42.252617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 273/540] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1548 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:42.257567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.258269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.269235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.269235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.269548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.270344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.271156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.271592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.277779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:42.374012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.374767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.386636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.387590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.388461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.389722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.390593 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.391418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.535733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.544977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f40be76d-3178-4f38-8dd8-28d5ba582570 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1548 microversion: 2.1 time: 0.291669 Aug 30 14:48:42.545684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 268/541] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1548 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:42.569941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.576156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.576933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Searching by: {'deleted': False, 'project_id': '30338c95ad8d476b89bbec65ad188b2d'} {{(pid=127176) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 14:48:42.597022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.597658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.598047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.598927 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.599551 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.600062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.641083 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.652370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4225be8e-aecd-4fa0-af34-e9e484b10075 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.282642 Aug 30 14:48:42.664133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 274/542] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:42.682131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.683532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.691010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.691506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.691936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.692871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.693336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.693761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.762780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.multi_cell_list [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127176) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 14:48:42.864568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.873284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.874687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.875841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1ba4cc02-03d6-42d4-93b3-dc766f80be88 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.198376 Aug 30 14:48:42.876659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 275/543] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:48:42.881096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.882596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.890013 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.890464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.890916 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.891931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.892549 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.893111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.906508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-81ecc350-2aa6-4c49-8741-6ae93cf9a9d4 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.342891 Aug 30 14:48:42.907104 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 269/544] 10.222.0.25 () {58 vars in 1125 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:48:42.911061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:42.920837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.921464 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.929129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.929780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.930309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.931097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.931697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.932412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.979248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:42.988184 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ec96283b-d247-4b48-9ce8-86986d1f9bb9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1192 microversion: 2.1 time: 0.110601 Aug 30 14:48:42.989076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 276/545] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:43.093008 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:43.103410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-79bd60e1-3dfa-4d82-a35a-b83359627d5e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1548 microversion: 2.1 time: 0.187443 Aug 30 14:48:43.103990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 270/546] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:43.675948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:43.676583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:43.679025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:43.684799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.685276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.685702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:43.686388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.686828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.687247 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:43.837009 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:43.846512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b9283777-ba93-4311-aad4-8b4c68bcb3b6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.174543 Aug 30 14:48:43.847091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 277/547] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:43 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:43.903621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:43.904545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:43.911116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.911592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.912029 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:43.912764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.913218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.913627 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.010748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:44.011354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:44.022464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.022464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.022464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.022464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.023216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.023216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.109722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:44.114647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:44.118550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c3d70655-21c9-47af-8fd6-81f2e213e79b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1192 microversion: 2.1 time: 0.113162 Aug 30 14:48:44.119164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 278/548] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:44 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:44.123884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:44.125331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:44.126657 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-df42b6ca-9e9f-473e-be23-724e412d0939 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.227056 Aug 30 14:48:44.127232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 271/549] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:43 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:44.871374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:44.872024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:44.879631 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.880174 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.880641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.881345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.881825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.882396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.034855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:45.043990 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-812671e0-a489-460a-9ef0-7cc01fa42753 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.177945 Aug 30 14:48:45.044630 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 279/550] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:44 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:45.139527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:45.140192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:45.147507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.148125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.148562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.149269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.149513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:45.149675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.150106 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:45.150267 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.156446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.156922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.157348 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.158031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.158477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.158890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.239108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:45.247662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6c2d8886-d472-4fee-9a16-d522a58e71fe tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1192 microversion: 2.1 time: 0.112242 Aug 30 14:48:45.248287 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 272/551] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:45 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:45.313750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:45.322380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:45.323793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:45.324998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6536460e-94b5-4621-9aa0-27f00703c596 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.179443 Aug 30 14:48:45.325541 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 280/552] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:45 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:46.067867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:46.068413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:46.075161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.075648 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.076161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.076848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.077294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.077715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.211403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:46.219864 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0dbf134e-e6c9-4de0-8954-41498154a853 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.155955 Aug 30 14:48:46.220516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 273/553] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:46 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:46.268931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:46.269520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:46.276409 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.276892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.277315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.277999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.278446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.278861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.348347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:46.348954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:46.349797 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:46.355758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.356549 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.356980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.357677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.358120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.358258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c939d189-d9b2-4026-9213-b8c64834f632 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1192 microversion: 2.1 time: 0.093176 Aug 30 14:48:46.358519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.359114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 281/554] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:46 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:46.493936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:46.502524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:46.503974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:46.505202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bce1f210-7b86-4f09-aa70-abd0e06d3cf9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.160823 Aug 30 14:48:46.505744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 274/555] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:46 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:47.241705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:47.242241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:47.248521 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.249000 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.249437 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.250123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.250563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.250977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.379096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:47.382459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:47.393525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.394057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:47.394590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.394758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.395788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.396328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.396821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.404729 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c30678a2-211f-4805-980a-52b7f5073cb5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.167157 Aug 30 14:48:47.406212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 282/556] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:47 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:47.463743 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:47.471702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-47a4a6d7-0d49-4c89-9bad-831359a2fc70 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1192 microversion: 2.1 time: 0.096447 Aug 30 14:48:47.472382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 275/557] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:47 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:47.530554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:47.531048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:47.537822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.538305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.538733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.539416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.539895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.540342 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.689942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:47.698956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:47.700412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:47.701602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-830bdc34-84dd-4fdd-83f5-5c6032bbaedd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.175108 Aug 30 14:48:47.702147 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 283/558] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:47 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:48.427044 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:48.427621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:48.435623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.436353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.436780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.437504 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.437948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.438359 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.492803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:48.493488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:48.501370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.501581 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.502357 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.503268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.503901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.504515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.632608 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:48.641392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b52f5a21-459b-4ed5-ade4-90e3c0b1b568 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1210 microversion: 2.1 time: 0.152618 Aug 30 14:48:48.642125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 284/559] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:48 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1210 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:48.712975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:48.722018 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-adfaa215-0d61-4360-a618-935ab3078865 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.298690 Aug 30 14:48:48.732117 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 276/560] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:48 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:48.732314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:48.732314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:48.733624 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.734263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.735085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.735812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.736427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.736872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.987559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:48.997839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:49.001283 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:49.002714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bcfe0097-33e5-4929-b6c3-d1d64ca17c20 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.281791 Aug 30 14:48:49.011889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 285/561] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:48 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:49.662936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:49.663595 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:49.666609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:49.667287 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=94 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:49.674156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.674650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.675084 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.675786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.676262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.676681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.746112 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:49.746829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:49.748901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:49.749797 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:49.756417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.756906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.757374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.758076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.758516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.758914 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.966503 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:49.975020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-09b96b49-9eab-426d-bf26-2af02b7c2433 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.315940 Aug 30 14:48:49.975682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 277/562] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:49 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:50.013600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:50.022250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0a4b3fbf-92d2-471e-8a99-657afd9d7266 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.281009 Aug 30 14:48:50.022813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 286/563] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:49 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:50.041771 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:50.042569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:50.060230 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.061065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.061496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.062194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.062633 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.063047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.065438 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-fb805b66-3d9d-4076-9775-e4a84a7a9f55 req-70efe559-b6f9-4860-967f-f0666576aa3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74db9a17-f60a-45f7-a911-343fc374f92f", "tag": "a08e9383-4f8e-4d27-aa7a-f0a442fb1d85"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:50.075374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fb805b66-3d9d-4076-9775-e4a84a7a9f55 req-70efe559-b6f9-4860-967f-f0666576aa3c service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.075854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fb805b66-3d9d-4076-9775-e4a84a7a9f55 req-70efe559-b6f9-4860-967f-f0666576aa3c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.076458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-fb805b66-3d9d-4076-9775-e4a84a7a9f55 req-70efe559-b6f9-4860-967f-f0666576aa3c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.088663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-fb805b66-3d9d-4076-9775-e4a84a7a9f55 req-70efe559-b6f9-4860-967f-f0666576aa3c service nova] Creating event network-changed:a08e9383-4f8e-4d27-aa7a-f0a442fb1d85 for instance 74db9a17-f60a-45f7-a911-343fc374f92f on hv-cinder-82880 Aug 30 14:48:50.094405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-fb805b66-3d9d-4076-9775-e4a84a7a9f55 req-70efe559-b6f9-4860-967f-f0666576aa3c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032664 Aug 30 14:48:50.095574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 287/564] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:50.101312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb64c926-1c31-4f91-817b-a6c5566fa73a"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:50.103781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:50.110581 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.111258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.111688 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.112403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.112850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.113269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.239107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:50.249953 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:50.251527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:50.252739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2aeb055d-43f8-4d9d-bf66-35cc11eef6c7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.216133 Aug 30 14:48:50.253325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 278/565] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:50 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:50.997353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:50.998028 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:51.004684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.005159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.005588 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.006308 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.006746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.007159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.149344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:51.158022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-09e9e6f9-abd0-4693-9687-07c74d8a0620 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.164733 Aug 30 14:48:51.158595 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 279/566] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:50 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:51.162975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:51.163572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:51.169717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.170195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.170620 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.171303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.171752 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.172202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.321150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:51.330480 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5654ef22-6e19-4d9d-93cb-d07a7094a2c9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.170874 Aug 30 14:48:51.331067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 280/567] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:51 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:51.335483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:51.336058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:51.342623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.343142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.343578 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.344303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.344768 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.345166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.497108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:51.505374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:51.506782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:51.507942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-da36a48b-8a73-46b5-808d-3717ec683752 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.175983 Aug 30 14:48:51.508532 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 281/568] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:51 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:52.178613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:52.179294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:52.186965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.187451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.187882 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.188632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.189082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.189506 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.338568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:52.349893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4bdc5ae9-32fa-4d9a-929e-22548b72dffd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.175104 Aug 30 14:48:52.350728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 282/569] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:52 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:52.355807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:52.356451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:52.362864 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.363351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.363782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.364513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.364960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.365378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.503432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:52.512773 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-61c71c42-11ba-4d3a-8702-2a96a39d5fd6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.160750 Aug 30 14:48:52.513349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 283/570] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:52 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:52.531550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:52.532185 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:52.538430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.539050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.539984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.545303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.545303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.545303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.559188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:52.658501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:52.699132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:52.707921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:52.709365 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:52.710509 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-86dc5d13-78a7-4b25-b162-25350ca58e67 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.183074 Aug 30 14:48:52.711160 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 284/571] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:52 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:48:53.378765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:53.379368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:53.387126 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.387591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.388071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.388811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.389262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.389684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.535650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:53.543781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d77d627d-f2ea-4d6a-9779-fa7395273102 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.168844 Aug 30 14:48:53.544404 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 285/572] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:53 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:53.548850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:53.549437 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:53.555818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.556303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.556741 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.557809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.558263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.558683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.703707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:53.712606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0580734b-b566-4033-a275-e3eb0fb76eff tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.167014 Aug 30 14:48:53.713188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 286/573] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:53 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:53.734011 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:53.734614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:53.742147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.742805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.743108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.744045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.744510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.744923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.881857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:53.891039 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:53.892497 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:53.893663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fd2ea3d2-7a01-4adc-8126-056ec9e0aeab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.163747 Aug 30 14:48:53.894210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 287/574] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:53 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:54.564949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:54.565688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:54.573132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.573598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.574062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.574764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.575214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.575634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.719345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:54.727946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-91fbcd7d-a399-468d-8e1f-a4b569cc6cc1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.166807 Aug 30 14:48:54.728581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 288/575] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:54 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:54.734499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:54.735229 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:54.742240 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.742749 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.743223 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.744068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.744530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.744955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.902506 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:54.915353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7273c785-23a1-4b10-be86-45d910c7da35 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.183462 Aug 30 14:48:54.915556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 289/576] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:54 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:48:54.920505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:54.921105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:54.927333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.927819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.928306 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.929000 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.929442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.929853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.064914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:55.075383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:55.076852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:55.078015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8eacd41e-d677-475b-addd-f8e0ed8792f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.161639 Aug 30 14:48:55.078574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 290/577] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:54 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:55.761412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:55.762139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:55.769001 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.769515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.769938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.770640 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.771089 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.771521 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.922283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:55.931779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-184ee566-6208-496e-bccd-96f5cf34fee7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.174165 Aug 30 14:48:55.932839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 291/578] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:55 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:55.937966 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-62bde3f3-9c5c-4a2c-9ba0-4b7ef7cde1dd req-70763f1d-7d4e-4323-bf1c-b22b06e19cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1622c2-5c2a-4656-b39c-0f2f520fcf52", "name": "network-vif-plugged", "status": "completed", "tag": "cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:48:55.949103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-62bde3f3-9c5c-4a2c-9ba0-4b7ef7cde1dd req-70763f1d-7d4e-4323-bf1c-b22b06e19cc3 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.949598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-62bde3f3-9c5c-4a2c-9ba0-4b7ef7cde1dd req-70763f1d-7d4e-4323-bf1c-b22b06e19cc3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.950257 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-62bde3f3-9c5c-4a2c-9ba0-4b7ef7cde1dd req-70763f1d-7d4e-4323-bf1c-b22b06e19cc3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.965855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-62bde3f3-9c5c-4a2c-9ba0-4b7ef7cde1dd req-70763f1d-7d4e-4323-bf1c-b22b06e19cc3 service nova] Creating event network-vif-plugged:cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1 for instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 on hv-cinder-82880 Aug 30 14:48:55.970995 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-62bde3f3-9c5c-4a2c-9ba0-4b7ef7cde1dd req-70763f1d-7d4e-4323-bf1c-b22b06e19cc3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037058 Aug 30 14:48:55.971589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 292/579] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:55.976584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:55.977273 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:55.984099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.984576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.985004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.985705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.986155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.986547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:56.132704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:56.142797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a2fe048b-2b4c-4542-9cb4-f990e731406b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.170003 Aug 30 14:48:56.143386 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 293/580] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:55 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:56.148127 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:56.148839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:56.155341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:56.155827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:56.156275 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:56.156978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:56.157427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:56.157842 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:56.301552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:56.309268 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:56.310712 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:56.311939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-77284140-56b7-43ae-ae47-fa8333784f7e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.167538 Aug 30 14:48:56.312506 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 294/581] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:56 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:56.954510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:56.955179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:56.964413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:56.964989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:56.965633 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:56.966545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:56.966983 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:56.967536 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.358803 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:57.369693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a00989ab-151b-4e1c-a52e-451ba7dff919 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.419477 Aug 30 14:48:57.370264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 295/582] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:56 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:57.374680 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:57.375441 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:57.381865 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:57.382350 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:57.382785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.383478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:57.384061 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:57.384512 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.523666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:57.532987 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-98e2e500-1763-495d-b268-e962e40b915c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.161770 Aug 30 14:48:57.533555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 296/583] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:57 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:57.537985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:57.538581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:57.544740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:57.545225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:57.545658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.546347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:57.546803 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:57.547193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.685012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:57.693515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:57.694934 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:57.696166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-09ea9d60-a76c-48fc-ba0f-d2eae3ac04c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.161663 Aug 30 14:48:57.696756 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 297/584] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:57 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:58.011948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-90c0e220-e3e4-4a39-bf77-83ce70fb509f tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.914539 Aug 30 14:48:58.012591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 288/585] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:48:50 2022] POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments => generated 194 bytes in 7916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:58.390935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:58.391636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:58.398333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.398808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.399351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.399946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.400413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.400814 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.556335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:58.557214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:58.564908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.565399 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.565830 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.566618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.567341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.567765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.645006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:58.654611 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9e7cb28b-4994-4b6e-b1f4-931dff3f4927 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1278 microversion: 2.1 time: 0.267508 Aug 30 14:48:58.655186 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 298/586] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:58 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:58.721110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:58.721818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:58.728969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.729376 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.729809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.730513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.730950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.731369 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.763943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:58.772857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-26cfc253-84f7-4846-a9ad-ca76da80feac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.221574 Aug 30 14:48:58.786970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 289/587] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:58 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:58.870190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:58.880980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:58.883049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:58.885649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-23c9067f-519e-4b32-86f2-947db74bde3f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.167494 Aug 30 14:48:58.886423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 299/588] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:58 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:48:59.675493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:59.676314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:59.683244 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.683803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.684324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.685103 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.685612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.686221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.795258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:59.795844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:59.802435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.802913 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.803330 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.804056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.804500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.804910 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.829090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:59.837127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8df526e2-a8fa-4619-8c3f-1343a2a5a883 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.165378 Aug 30 14:48:59.837715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 290/589] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:59 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:48:59.910693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:59.911451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:59.919175 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.919787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.920496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.921326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.921899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.922412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.948744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:48:59.957663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bf62659b-80dd-4a25-928f-d7a4e6d96d98 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.166293 Aug 30 14:48:59.969813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 300/590] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:48:59 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:00.062907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:00.074259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:00.075664 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:00.076851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9c74624a-595c-4488-a244-2f6a748121d4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.170898 Aug 30 14:49:00.077412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 291/591] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:48:59 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:00.858465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:00.859067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:00.865971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.866515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.866894 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:00.867581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.868465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.868465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:00.978982 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:00.979609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:00.986465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.986931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.987358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:00.988083 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.988527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.988941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.004486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:01.017312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:01.019662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:01.026599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c898930a-66af-45b1-bb33-5b602a99b27f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.172066 Aug 30 14:49:01.027182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 301/592] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:00 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:01.099236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:01.099855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:01.105914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.106391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.106798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.107479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.107919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.108432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.129047 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:01.138928 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7e228d2a-7ac6-4a47-bb5b-b58abc119413 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.162794 Aug 30 14:49:01.148321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 292/593] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:00 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:01.250187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:01.261755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:01.263742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:01.265665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5fba1aec-1038-4e6a-aa5d-b8032ae3582f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.170509 Aug 30 14:49:01.266414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 302/594] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:01 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:01.827508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:01.828261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:01.835181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.835647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.836144 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.836869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.837380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.837810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.863954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e49dab65-9037-4f9b-92ab-5cf88de2cc10 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/ips" status: 200 len: 151 microversion: 2.1 time: 0.040677 Aug 30 14:49:01.864595 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 293/595] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:49:01 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:02.053975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:02.055913 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:02.068283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.069132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.069855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.071090 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.072020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.072796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.159516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:02.160864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:02.168926 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.169816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.170330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.171276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.172194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.172831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.344363 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:02.353399 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ef821357-9d73-43c7-b63e-797ca8779ec7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.307393 Aug 30 14:49:02.355434 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 303/596] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:02 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:02.361244 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:02.363203 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:02.370187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.370830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.371534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.372458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.372973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.373424 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.380395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:02.389875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-01d02273-0706-4a0a-a140-057e050830b7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.234756 Aug 30 14:49:02.390576 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 294/597] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:02 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:02.517654 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:02.526256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:02.527660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:02.528880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6b750ae1-9f99-45d4-a3a5-014372c31ce4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.172019 Aug 30 14:49:02.529401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 304/598] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:02 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:03.381675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:03.382869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:03.389651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.390105 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.390555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.391242 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.391691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.392128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.415197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:03.416178 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:03.428380 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.428380 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.428380 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.428380 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.428687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.428687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.583912 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:03.592710 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5b7033ef-9a96-4d1a-bc0a-228fe3e22cfc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.184735 Aug 30 14:49:03.593416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 305/599] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:03 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:03.597865 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:03.598665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:03.606143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.606897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.607377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.610101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.610101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.610101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.722265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:03.731653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-35c8189e-1e52-479f-ae04-b486dc85ecf6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.356226 Aug 30 14:49:03.732279 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 295/600] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:03 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:03.778496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:03.786979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:03.788430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:03.789589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-071a1cc1-80a4-4816-b89c-51b9e6b1fdf1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.195370 Aug 30 14:49:03.790410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 306/601] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:03 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:04.615745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:04.616361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:04.625222 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.625708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.626136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.626852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.627300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.627718 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.752869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:04.753484 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:04.760887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.761379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.761819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.762527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.763095 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.763524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.771253 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:04.779908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9af4263b-9d73-4e14-9da9-c0d09e4d9bde tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.169202 Aug 30 14:49:04.780728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 296/602] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:04 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:04.812999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:04.813599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:04.819682 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.820202 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.820627 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.821566 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.822072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.822493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.937324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:04.946847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d08acbab-8bdc-4296-9856-72276a1bff33 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.197805 Aug 30 14:49:04.947461 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 307/603] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:04 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:04.982061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:04.990359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:04.991792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:04.993294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2aea5a76-5319-483e-80d8-8fe758da71ff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.183926 Aug 30 14:49:04.993872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 297/604] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:04 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:05.802835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:05.803384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:05.811263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.811816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.812275 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:05.812970 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.813416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.813831 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:05.968702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:05.969951 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:05.978827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.979467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.979906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:05.981037 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.981486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.981901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:06.027878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:06.037956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-71382bc6-d895-4ba3-b114-8847261217e2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.239075 Aug 30 14:49:06.038616 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 308/605] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:05 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:06.043554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:06.044203 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:06.050719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:06.051205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:06.051636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:06.052548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:06.053055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:06.053412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:06.184555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:06.193079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-23a900b1-4cdd-4134-8b57-e8474c337fa3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.229849 Aug 30 14:49:06.194010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 298/606] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:05 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:06.241567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:06.250781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:06.252223 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:06.253383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bc47aad4-1e7b-4474-8141-18d52c244179 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1743 microversion: 2.20 time: 0.213523 Aug 30 14:49:06.253914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 309/607] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:06 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:07.065145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:07.066403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:07.073054 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.073550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.074020 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.074723 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.075140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.075861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.220679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:07.222604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:07.225106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:07.230550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6346cad7-87dd-47ad-b361-4b011d70ddcd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1723 microversion: 2.1 time: 0.170169 Aug 30 14:49:07.231456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 299/608] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:07 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:07.235425 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.236233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.236884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.237822 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.238870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.239522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.276936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:07.277546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:07.285727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.286530 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.287193 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.288121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.288795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.289269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.533650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:07.547356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:07.548801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a9377dbe-26ed-4ec4-9e9e-f52b4ab3512e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.333417 Aug 30 14:49:07.549406 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 310/609] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:07 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:07.560917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:07.566139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:07.568261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b9fd0649-0d4f-4aeb-bee6-15812b67abdc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.295826 Aug 30 14:49:07.568976 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 300/610] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:07 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:07.607162 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e67966e4-d138-41f2-88e1-4672ca54e786"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:07.611341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:07.618514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.619574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.620047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.620763 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.621222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.621910 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.100739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3f56046d-0bff-4f6b-b412-ccead4821370 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497427 Aug 30 14:49:08.101656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 311/611] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:49:07 2022] POST /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments => generated 194 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:08.255835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:08.257596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:08.283215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.286868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.293271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.295829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.298098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.298766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.531752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:08.540964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0bf6ba1d-12f4-422d-bc69-11abb9a5ddda tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1700 microversion: 2.1 time: 0.291640 Aug 30 14:49:08.541705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 301/612] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:08 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1700 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:08.565692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-95b4ed74-31fd-4f16-a235-c810dd6dd114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:08.571404 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:08.573021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-95b4ed74-31fd-4f16-a235-c810dd6dd114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.573194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:08.573531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-95b4ed74-31fd-4f16-a235-c810dd6dd114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.573961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-95b4ed74-31fd-4f16-a235-c810dd6dd114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.589242 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.590029 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.590736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.591506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.592176 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.592909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.644338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-95b4ed74-31fd-4f16-a235-c810dd6dd114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Going to try to start instance {{(pid=127176) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 14:49:08.708110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-95b4ed74-31fd-4f16-a235-c810dd6dd114 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action" status: 202 len: 0 microversion: 2.1 time: 0.147953 Aug 30 14:49:08.721620 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 312/613] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:49:08 2022] POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 14:49:08.752870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:08.754288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:08.765568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.766350 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.767545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.769064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.770277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.771271 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.825052 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:08.842268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a3423475-3b83-43e5-bc6b-ae65fd6a51ef tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.275197 Aug 30 14:49:08.843381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 302/614] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:08 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:08.862204 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:08.863142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:08.879836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.880743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.881995 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.885159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.885640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.886071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.176460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:09.187363 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:09.189297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:09.190711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f668c9bf-b204-41c5-a77d-9a140e99f3b2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.458168 Aug 30 14:49:09.191915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 313/615] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:08 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:09.241132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:09.252543 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-62d0abf5-f521-45ef-9c2e-e58c27b9205e tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1709 microversion: 2.1 time: 0.407699 Aug 30 14:49:09.257709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 303/616] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:08 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1709 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:09.425410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:09.426262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:09.439863 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.440854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.441959 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.443060 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.443679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.444121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.657679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lazy-loading 'services' on Instance uuid c605be08-2590-47c6-9197-2b7046cb3acf {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:49:09.790896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b6802787-f286-4ff2-90b7-7327b6c4dad9 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf/os-volume_attachments/d3797307-6eb5-42b5-83f0-35558703e81b" status: 202 len: 0 microversion: 2.1 time: 0.371568 Aug 30 14:49:09.791806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 314/617] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:49:09 2022] DELETE /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf/os-volume_attachments/d3797307-6eb5-42b5-83f0-35558703e81b => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:49:09.875584 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:09.876697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:09.884803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.885291 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.885721 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.886425 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.886872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.887296 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.059300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:10.068432 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-80d7838e-e9c8-47dd-abc6-12815075ebcd tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.201300 Aug 30 14:49:10.069266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 304/618] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:09 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:10.223976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:10.225205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:10.232199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.232681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.233104 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.233800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.234234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.234666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.251537 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:10.291579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:10.295620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:10.318557 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.319551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.320213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.322327 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.322838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.323451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.541408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:10.545843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:10.556731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:10.558564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:10.559746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f1b35262-353a-47c8-86ef-d787dc61769e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.340453 Aug 30 14:49:10.560647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 315/619] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:10 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:10.563131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5d56f049-2287-46e9-abdc-397e883502aa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1709 microversion: 2.1 time: 0.286805 Aug 30 14:49:10.563894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 305/620] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:10 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1709 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:11.092044 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:11.093140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:11.104298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.104579 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.104934 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.105670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.106144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.106557 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.288289 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:11.300922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5fb1c495-c411-4f1b-9e83-a502ffa30681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.214203 Aug 30 14:49:11.302011 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 316/621] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:11 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:11.587080 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:11.588036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:11.592323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:11.594937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:11.601987 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.602601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.603312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.604275 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.604740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.605171 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.613881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.614616 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.615547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.616620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.617660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.619768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.884305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:11.887476 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:11.902047 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:11.905043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-397184b2-c83e-41a6-8be6-9efecbbc4cf1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1713 microversion: 2.1 time: 0.323003 Aug 30 14:49:11.905259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:11.906726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 317/622] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:11 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1713 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:11.912154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ff9ba392-33c8-44d8-9b2c-f5e0608723d3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.329519 Aug 30 14:49:11.912756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 306/623] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:11 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:12.327860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:12.328597 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:12.335001 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.335587 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.336040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:12.337069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.337069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.343896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:12.506755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:12.516918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fb153ac3-9621-4dc3-88d9-0d45cf63241a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.195802 Aug 30 14:49:12.530513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 318/624] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:12 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:12.939630 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:12.941857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:12.950953 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.952687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.953828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:12.955108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.955957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.956831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:13.128461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:13.146674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:13.149516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:13.151588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1e959824-c2cc-4c05-b3c7-90779f104f9b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.215935 Aug 30 14:49:13.164042 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 307/625] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:12 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:13.545296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:13.546821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:13.554550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:13.555411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:13.556897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:13.558241 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:13.558841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:13.559249 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:13.712876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:13.723989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-64b154cd-cfbc-4f02-9820-68c5c1a400b8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.181398 Aug 30 14:49:13.724638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 319/626] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:13 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:14.181180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:14.181811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:14.202254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=62 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:14.202254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.202254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.202254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:14.202759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.202759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.202759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:14.434333 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:14.443567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:14.445131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:14.446465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b16a14c6-646f-44b6-8e3b-e0769cc1f097 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.269394 Aug 30 14:49:14.450513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 308/627] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:14 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:14.746797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:14.747687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:14.760457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.761185 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.761392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:14.762762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.764290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.764952 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:15.014526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:15.023602 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0b1233f9-99d9-4129-adac-7cbfdf8f7ca8 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.282409 Aug 30 14:49:15.038251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 320/628] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:14 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:15.591109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:15.592036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:15.599689 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:15.600281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:15.600896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:15.601758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:15.602479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:15.603069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:15.638356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:15.638965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:15.645536 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:15.646021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:15.646450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:15.647443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:15.647821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:15.648267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:15.673760 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:15.843414 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:15.855751 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:15.857774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:15.859186 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-59fde671-0d20-4ca6-86d2-68c64600de68 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.384032 Aug 30 14:49:15.860519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 309/629] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:15 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:15.872285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:15.882533 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-59b69552-d67c-4d39-8631-4f1a452bc674 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1594 microversion: 2.1 time: 0.295246 Aug 30 14:49:15.883113 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 321/630] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:15 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1594 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:16.062491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:16.063110 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:16.072788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.073888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.074530 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:16.075508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.076178 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.076803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:16.253918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:16.269918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1c123c7d-c2cf-4e49-8b1d-874c62ab7028 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.225688 Aug 30 14:49:16.285313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 310/631] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:16 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:16.828270 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-944ff301-b8dd-4979-b3c9-602db49cc3dd req-5fd25d11-9213-4b1c-8049-40cb7ad04b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74db9a17-f60a-45f7-a911-343fc374f92f", "name": "network-vif-plugged", "status": "completed", "tag": "a08e9383-4f8e-4d27-aa7a-f0a442fb1d85"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:16.838850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-944ff301-b8dd-4979-b3c9-602db49cc3dd req-5fd25d11-9213-4b1c-8049-40cb7ad04b34 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.839319 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-944ff301-b8dd-4979-b3c9-602db49cc3dd req-5fd25d11-9213-4b1c-8049-40cb7ad04b34 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.839737 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-944ff301-b8dd-4979-b3c9-602db49cc3dd req-5fd25d11-9213-4b1c-8049-40cb7ad04b34 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:16.851324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-944ff301-b8dd-4979-b3c9-602db49cc3dd req-5fd25d11-9213-4b1c-8049-40cb7ad04b34 service nova] Creating event network-vif-plugged:a08e9383-4f8e-4d27-aa7a-f0a442fb1d85 for instance 74db9a17-f60a-45f7-a911-343fc374f92f on hv-cinder-82880 Aug 30 14:49:16.856497 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-944ff301-b8dd-4979-b3c9-602db49cc3dd req-5fd25d11-9213-4b1c-8049-40cb7ad04b34 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033378 Aug 30 14:49:16.857632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 322/632] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:16.882654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:16.883256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:16.890636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.891360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.891966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:16.892870 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.893771 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.894339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:17.097416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:17.111077 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:17.113435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:17.115135 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-734777d8-4059-48d6-b6c4-1dcc6ae889bf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.236693 Aug 30 14:49:17.116544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 311/633] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:16 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:17.295294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:17.296781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:17.306231 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:17.307583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:17.308309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:17.309296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:17.310442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:17.311347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:17.579805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:17.606318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e9589968-d022-4f4a-ae3d-9704a394e822 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.316415 Aug 30 14:49:17.606941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 323/634] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:17 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:18.140636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:18.141433 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:18.156298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.156869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.157315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.158055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.158523 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.158938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.360619 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-b4bdc7df-1471-4c3e-b8b9-5d32ca1ab3b3 req-5ea34aea-ced5-4435-86ec-11c2cf785e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e57929-37de-4ea1-b61a-01b83a906ad1", "tag": "649219cb-9d47-46d0-bb79-dbd9ce7a2960"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:18.361129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:18.371303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:18.374544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-b4bdc7df-1471-4c3e-b8b9-5d32ca1ab3b3 req-5ea34aea-ced5-4435-86ec-11c2cf785e57 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.375030 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-b4bdc7df-1471-4c3e-b8b9-5d32ca1ab3b3 req-5ea34aea-ced5-4435-86ec-11c2cf785e57 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.375457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-b4bdc7df-1471-4c3e-b8b9-5d32ca1ab3b3 req-5ea34aea-ced5-4435-86ec-11c2cf785e57 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.380145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:18.381912 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-13dbce6b-6fea-45ad-bd73-8faaea8935aa tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.245198 Aug 30 14:49:18.382690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 312/635] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:18 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:18.403949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-b4bdc7df-1471-4c3e-b8b9-5d32ca1ab3b3 req-5ea34aea-ced5-4435-86ec-11c2cf785e57 service nova] Creating event network-changed:649219cb-9d47-46d0-bb79-dbd9ce7a2960 for instance a8e57929-37de-4ea1-b61a-01b83a906ad1 on hv-cinder-82880 Aug 30 14:49:18.409650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-b4bdc7df-1471-4c3e-b8b9-5d32ca1ab3b3 req-5ea34aea-ced5-4435-86ec-11c2cf785e57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056262 Aug 30 14:49:18.410281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 324/636] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:49:18.643627 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:18.644771 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:18.653614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.655321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.655937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.658090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.658997 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.659605 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.945237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:18.958862 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d0ff933a-e60e-42b9-b08d-8b5f99ecab57 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1266 microversion: 2.1 time: 0.325495 Aug 30 14:49:18.962525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 313/637] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:18 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:19.410657 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:19.412174 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:19.421214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.421709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.422215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.422941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.423394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.423814 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.633534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:19.642609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-407758621"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:19.643334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:19.643470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:19.645623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:19.648274 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-452c9fac-7a1e-4830-8b1e-2d2fa24cec76 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1738 microversion: 2.20 time: 0.242624 Aug 30 14:49:19.649734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 325/638] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:19 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:19.655825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.656740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.657431 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.658886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.660390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.661202 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.823276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.network.security_group_api [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Adding security group d7bfd76c-3b55-44fd-a207-38e200256933 to port 649219cb-9d47-46d0-bb79-dbd9ce7a2960 Aug 30 14:49:19.983975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:19.984513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:19.986551 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=98 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:19.992149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.992632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.993104 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.993801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.994256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.994796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.500034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:20.508548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7a2db170-d4a7-4a73-b344-0f3174cf5342 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1453 microversion: 2.1 time: 0.529538 Aug 30 14:49:20.509387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 326/639] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:19 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1453 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:20.530788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:20.531398 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:20.537496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.537976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.538459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.539135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.539596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.540234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.591426 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-544c4e22-d8e9-4c54-a8ae-9d81a2146428 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.956586 Aug 30 14:49:20.592041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 314/640] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:49:19 2022] POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/action => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:49:20.600625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:20.601232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:20.607815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.608343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.609416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.610151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.610603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.611019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.950333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:20.960815 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6f012098-9574-4f4a-aa8d-ce23c4c94fe9 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1453 microversion: 2.1 time: 0.434115 Aug 30 14:49:20.962259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 327/641] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:20 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1453 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:20.971670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-d663031b-bbe2-4ece-8ccf-85700b1d0d29 req-66ced0a9-6dd1-40a5-9410-307b33a72034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e57929-37de-4ea1-b61a-01b83a906ad1", "tag": "649219cb-9d47-46d0-bb79-dbd9ce7a2960"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:20.985296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-d663031b-bbe2-4ece-8ccf-85700b1d0d29 req-66ced0a9-6dd1-40a5-9410-307b33a72034 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.987444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-d663031b-bbe2-4ece-8ccf-85700b1d0d29 req-66ced0a9-6dd1-40a5-9410-307b33a72034 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.988733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-d663031b-bbe2-4ece-8ccf-85700b1d0d29 req-66ced0a9-6dd1-40a5-9410-307b33a72034 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.996329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:21.005648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c8d86602-37b2-4438-a9f7-ae07e01feb2a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1640 microversion: 2.1 time: 0.408762 Aug 30 14:49:21.020560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-d663031b-bbe2-4ece-8ccf-85700b1d0d29 req-66ced0a9-6dd1-40a5-9410-307b33a72034 service nova] Creating event network-changed:649219cb-9d47-46d0-bb79-dbd9ce7a2960 for instance a8e57929-37de-4ea1-b61a-01b83a906ad1 on hv-cinder-82880 Aug 30 14:49:21.021541 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 315/642] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:20 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1640 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:21.023241 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-d663031b-bbe2-4ece-8ccf-85700b1d0d29 req-66ced0a9-6dd1-40a5-9410-307b33a72034 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057600 Aug 30 14:49:21.024229 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 328/643] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:21.032286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:21.033194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:21.040435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:21.041476 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:21.042399 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:21.043442 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:21.044252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:21.044817 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:21.211506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:21.221075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:21.222836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:21.224334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9d4c2a68-0805-460a-88fd-16b3792361ac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1720 microversion: 2.20 time: 0.201401 Aug 30 14:49:21.225235 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 316/644] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:21 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:22.257259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:22.260161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:22.277658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:22.278687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:22.279592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:22.281058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:22.283405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:22.284334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:22.480601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:22.488349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:22.490809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:22.492223 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-314ce114-d25a-490f-913d-b4d6e801da81 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1720 microversion: 2.20 time: 0.246763 Aug 30 14:49:22.492827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 329/645] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:22 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:22.552706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-08a18136-4664-47a0-b119-a01da8066cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: .version_select at 0x7fe6a64f8e50>, body: {"keypair": {"name": "tempest-keypair-835778948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9x1bWp09ytKGJy8dKXvOGoYcbFDLc4zJpEERqhESw0AbCxDx2ZuCeQ+iydNntWxTDG5gWfCCgofx+lcuMAGxHTAaS1G9WeTTv36aoIgnA+MznlGQyVaTL5/t5a8EgX0A=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:22.570210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-08a18136-4664-47a0-b119-a01da8066cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:49:22.574563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-08a18136-4664-47a0-b119-a01da8066cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:49:22.604307 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-08a18136-4664-47a0-b119-a01da8066cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055590 Aug 30 14:49:22.604901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 317/646] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:49:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:22.730038 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-5d9d42a4-0596-49e3-a0dd-df33a46dbb39 req-528075e9-d371-4948-901f-51ecbe06420f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1622c2-5c2a-4656-b39c-0f2f520fcf52", "name": "network-vif-unplugged", "status": "completed", "tag": "cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:22.741600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5d9d42a4-0596-49e3-a0dd-df33a46dbb39 req-528075e9-d371-4948-901f-51ecbe06420f service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:22.742321 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5d9d42a4-0596-49e3-a0dd-df33a46dbb39 req-528075e9-d371-4948-901f-51ecbe06420f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:22.743013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5d9d42a4-0596-49e3-a0dd-df33a46dbb39 req-528075e9-d371-4948-901f-51ecbe06420f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:22.762547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-5d9d42a4-0596-49e3-a0dd-df33a46dbb39 req-528075e9-d371-4948-901f-51ecbe06420f service nova] Creating event network-vif-unplugged:cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1 for instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 on hv-cinder-82880 Aug 30 14:49:22.770402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-5d9d42a4-0596-49e3-a0dd-df33a46dbb39 req-528075e9-d371-4948-901f-51ecbe06420f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044600 Aug 30 14:49:22.772238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 330/647] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:23.072685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-6592a848-f4dc-441e-a18e-6e4b2c0c84cf req-291846f4-325e-4d9f-a743-07945ca7470f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74db9a17-f60a-45f7-a911-343fc374f92f", "tag": "a08e9383-4f8e-4d27-aa7a-f0a442fb1d85"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:23.085396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-6592a848-f4dc-441e-a18e-6e4b2c0c84cf req-291846f4-325e-4d9f-a743-07945ca7470f service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:23.085884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-6592a848-f4dc-441e-a18e-6e4b2c0c84cf req-291846f4-325e-4d9f-a743-07945ca7470f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:23.086986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-6592a848-f4dc-441e-a18e-6e4b2c0c84cf req-291846f4-325e-4d9f-a743-07945ca7470f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:23.107949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-6592a848-f4dc-441e-a18e-6e4b2c0c84cf req-291846f4-325e-4d9f-a743-07945ca7470f service nova] Creating event network-changed:a08e9383-4f8e-4d27-aa7a-f0a442fb1d85 for instance 74db9a17-f60a-45f7-a911-343fc374f92f on hv-cinder-82880 Aug 30 14:49:23.115332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-6592a848-f4dc-441e-a18e-6e4b2c0c84cf req-291846f4-325e-4d9f-a743-07945ca7470f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046221 Aug 30 14:49:23.116333 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 318/648] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:23.520682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:23.522375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:23.530545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:23.531040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:23.531473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:23.532236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:23.532687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:23.533099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:23.702000 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:23.710916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:23.712370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:23.713526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0a364e2d-42c9-419a-813e-8a6216ecfcc2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1720 microversion: 2.20 time: 0.200209 Aug 30 14:49:23.714333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 331/649] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:23 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:24.347952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-564610034", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f"}], "security_groups": [{"name": "tempest-securitygroup--400353597"}], "key_name": "tempest-keypair-835778948", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:24.467756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] validate_networks() for [('d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:49:24.740944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:24.742400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:24.747208 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:49:24.747645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Tue Aug 30 14:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 (ip 10.222.0.25) !!! Aug 30 14:49:24.757864 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:24.758850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:24.760040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:24.760833 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:24.761293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:24.761713 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.206560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:25.218353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:25.219725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:25.221209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9cd1c2c5-fb0c-4ea7-886e-fe8536eef1cd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1720 microversion: 2.20 time: 0.484544 Aug 30 14:49:25.224384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 332/650] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:24 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1720 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:25.231079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:25.231312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:25.238307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.239049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.239450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.240508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.241285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.241812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.273411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:49:25.320642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:25.396889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-df98c5aa-9109-4ace-9feb-15e0cd1f42e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 204 len: 0 microversion: 2.1 time: 0.169018 Aug 30 14:49:25.398589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 333/651] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:49:25 2022] DELETE /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:49:25.408516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:25.409347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:25.416776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.417275 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.417721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.418434 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.418886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.419313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.635143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:49:25.635641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:49:25.636022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:49:25.636428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:49:25.636837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:49:25.646176 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.646739 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.647085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.647920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.648388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.648884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.667046 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:49:25.671040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:49:25.682845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:49:25.685288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:49:25.696547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:25.704968 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f1e06540-709e-4e59-b787-5ea22326dca4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1513 microversion: 2.1 time: 0.301276 Aug 30 14:49:25.705874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 334/652] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:25 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:25.734653 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9e026e6f-fea5-4e19-87e9-14aea1b52210 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.391923 Aug 30 14:49:25.735296 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 319/653] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:49:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:49:25.746459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2cf1c9ab-7212-4752-afd6-12bff756ede7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:25.747077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2cf1c9ab-7212-4752-afd6-12bff756ede7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:25.808591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2cf1c9ab-7212-4752-afd6-12bff756ede7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:25.815825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2cf1c9ab-7212-4752-afd6-12bff756ede7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1240 microversion: 2.1 time: 0.073418 Aug 30 14:49:25.816447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 335/654] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:25 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:26.244350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:26.245334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:26.252612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.253104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.253542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.254230 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.254676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.255106 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.400526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:26.413116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:26.414634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:26.415823 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7ca4e120-1a51-4df6-b81b-8ef2bbae2428 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1723 microversion: 2.20 time: 0.175727 Aug 30 14:49:26.416403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 320/655] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:26 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:26.441633 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63fcfdcc-f07c-4e3a-8a84-f5665b34c047"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:26.445099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:26.453049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.453553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.453986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.454668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.455117 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.455534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.728250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:26.729038 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:26.735093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.735583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.736027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.736803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.737251 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.737671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.783648 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-aa1cef51-0d9e-4226-834e-670c0a4b2b83 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.348380 Aug 30 14:49:26.784799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 336/656] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Aug 30 14:49:26 2022] POST /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:26.836586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:26.837517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:26.843707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.844216 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.844830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.845519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.845963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.846380 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.894718 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:26.904012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-de6c4697-d7e8-4f42-8e03-69068ea348fd tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1513 microversion: 2.1 time: 0.180216 Aug 30 14:49:26.904972 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 321/657] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:26 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:26.917577 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:26.925093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:26.925687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:26.925822 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b2655823-d384-462d-b534-49cd1d12c9d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1244 microversion: 2.1 time: 0.093252 Aug 30 14:49:26.926414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 337/658] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:26 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:26.933198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.933796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.934234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.934937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.935381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.935803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.984820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127177) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 14:49:27.073065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-afbccf9d-7d38-46de-888f-354d334138a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/action" status: 202 len: 0 microversion: 2.20 time: 0.150640 Aug 30 14:49:27.073065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 322/659] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 14:49:26 2022] POST /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:49:27.081731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:27.082750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:27.096609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.097301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.097832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.098753 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.099525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.100189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.309262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:27.320058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:27.323186 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:27.324725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3353f2ce-713f-4f34-99aa-88820c101804 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1809 microversion: 2.20 time: 0.246929 Aug 30 14:49:27.325301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 338/660] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:27 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:27.931471 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:27.932892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:27.945384 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.947603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.948445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.949319 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:27.950115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.950285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:27.950464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.950908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.958602 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.960427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.963387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.964806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.966243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.967342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:28.192791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:28.202624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-efec5090-4964-4e01-9d96-4a68ec44eb82 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1236 microversion: 2.1 time: 0.259410 Aug 30 14:49:28.203139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 339/661] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:27 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1236 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:28.369589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:28.371156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:28.377735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:28.378533 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:28.379139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:28.379847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:28.380475 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:28.381049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:28.419104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:28.429857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-59c78928-f8ea-4d21-8b8a-5a129579fda4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1513 microversion: 2.1 time: 0.506725 Aug 30 14:49:28.430838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 323/662] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:27 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1513 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:28.694015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:28.718970 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:28.720575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:28.723071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1962f2b1-5948-41c0-a84f-662120f28256 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1749 microversion: 2.20 time: 0.358349 Aug 30 14:49:28.736619 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 340/663] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:28 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1749 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:29.035170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-42371290-6725-488f-b5ae-21057ff2e6eb req-d4e51545-4c42-44be-8cc7-994a78e41f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c605be08-2590-47c6-9197-2b7046cb3acf", "name": "network-vif-deleted", "tag": "142062f8-bbe6-465f-94e5-cd5a916b5637"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:29.052267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-42371290-6725-488f-b5ae-21057ff2e6eb req-d4e51545-4c42-44be-8cc7-994a78e41f7c service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.053101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-42371290-6725-488f-b5ae-21057ff2e6eb req-d4e51545-4c42-44be-8cc7-994a78e41f7c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.053560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-42371290-6725-488f-b5ae-21057ff2e6eb req-d4e51545-4c42-44be-8cc7-994a78e41f7c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.066697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-42371290-6725-488f-b5ae-21057ff2e6eb req-d4e51545-4c42-44be-8cc7-994a78e41f7c service nova] Creating event network-vif-deleted:142062f8-bbe6-465f-94e5-cd5a916b5637 for instance c605be08-2590-47c6-9197-2b7046cb3acf on hv-cinder-82880 Aug 30 14:49:29.072808 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-42371290-6725-488f-b5ae-21057ff2e6eb req-d4e51545-4c42-44be-8cc7-994a78e41f7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042258 Aug 30 14:49:29.076508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 324/664] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:29.231720 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:29.232632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:29.242422 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.243979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.244794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.246087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.246998 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.247746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.387416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:29.409400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3d2e1163-7cf3-48d8-93e3-7734719e749a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1300 microversion: 2.1 time: 0.185458 Aug 30 14:49:29.410440 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 341/665] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:29 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1300 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:29.454715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:29.456676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:29.467523 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.468240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.468796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.469724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.470230 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.470659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.510911 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.511446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.511887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.512967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lazy-loading 'fault' on Instance uuid c605be08-2590-47c6-9197-2b7046cb3acf {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:49:29.575194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:29.586740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cb3c83cf-601b-45aa-8c6b-ede1523bf2f7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 200 len: 1309 microversion: 2.1 time: 0.138473 Aug 30 14:49:29.587935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 325/666] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:29 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:29.753726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:29.755184 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:29.768897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.769697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.770681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.771965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.772767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.773500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.046178 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:30.060900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:30.062378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:30.063637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ee7eb0b4-85c1-4ac4-98f0-26030dc5f6f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1751 microversion: 2.20 time: 0.318590 Aug 30 14:49:30.064242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 342/667] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:29 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1751 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:30.442810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:30.445074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:30.458214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.459228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.460146 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.462010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.462881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.463697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.617227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:30.619222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: c605be08-2590-47c6-9197-2b7046cb3acf] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:30.630639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.632480 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.648252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.650641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.658172 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.659800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.694347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] HTTP exception thrown: Instance c605be08-2590-47c6-9197-2b7046cb3acf could not be found. Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Request method failure captured: Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf HTTP/1.1 Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiL5tpbUlo7dSfUzxVuA2k7PwOalsMSuvTBwKZcbJTDCELbcjbhBBrl-PFxA51K2lfsh5qT7fPImmVxGOaKq9vwFqFxrXmZxxpFvE8MGFpVKJbqnvzITAe7pTSGSeqdHzUSTHdkKVwRLMHtx71VefuZwZuRWHpsNNM-pH5wzyQ73WdU Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: d29d875fc4d84f92801112d6d2accd13 Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-VolumesSnapshotTestJSON-642501947 Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:49:30.697940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d29d875fc4d84f92801112d6d2accd13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d29d875fc4d84f92801112d6d2accd13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d29d875fc4d84f92801112d6d2accd13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d29d875fc4d84f92801112d6d2accd13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-VolumesSnapshotTestJSON-642501947 Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: d29d875fc4d84f92801112d6d2accd13 Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-642501947 Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-VolumesSnapshotTestJSON-642501947-project Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: bf6b353833f14c3d819164e23374591e Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-VolumesSnapshotTestJSON-642501947-project Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance c605be08-2590-47c6-9197-2b7046cb3acf could not be found. Aug 30 14:49:30.700978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': 'c605be08-2590-47c6-9197-2b7046cb3acf'} Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c605be08-2590-47c6-9197-2b7046cb3acf could not be found. Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:49:30.703473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c605be08-2590-47c6-9197-2b7046cb3acf could not be found. Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c605be08-2590-47c6-9197-2b7046cb3acf could not be found. Aug 30 14:49:30.708950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:49:30.714593 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Returning 404 to user: Instance c605be08-2590-47c6-9197-2b7046cb3acf could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:49:30.714593 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-edd5b032-5f81-4340-be2e-f89cc05575e4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf" status: 404 len: 111 microversion: 2.1 time: 0.089811 Aug 30 14:49:30.716184 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 343/668] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:30 2022] GET /compute/v2.1/servers/c605be08-2590-47c6-9197-2b7046cb3acf => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:49:30.810570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:30.826935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f3ffae9c-d059-4cef-8b83-e803e5121ea5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.393068 Aug 30 14:49:30.829630 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 326/669] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:30 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:31.093852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:31.094767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:31.109601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.110538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.111771 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.112972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.113807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.114551 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.354699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:31.367217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:31.368293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:31.369522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7ca164d1-fba5-4c3d-a8df-abd73bb9ef1a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.283534 Aug 30 14:49:31.370336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 344/670] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:31 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:31.382426 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-be62058d-eaf6-4806-a123-c31529e2b3ad req-50aa0e14-c1b2-4f82-b465-8ac847f1eb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a8e249-ce8d-48bd-af4e-ae32d0eed382", "tag": "c3907648-f43c-43ba-9e60-96fe2de992af"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:31.396869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-be62058d-eaf6-4806-a123-c31529e2b3ad req-50aa0e14-c1b2-4f82-b465-8ac847f1eb14 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.397590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-be62058d-eaf6-4806-a123-c31529e2b3ad req-50aa0e14-c1b2-4f82-b465-8ac847f1eb14 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.398236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-be62058d-eaf6-4806-a123-c31529e2b3ad req-50aa0e14-c1b2-4f82-b465-8ac847f1eb14 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.412372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-be62058d-eaf6-4806-a123-c31529e2b3ad req-50aa0e14-c1b2-4f82-b465-8ac847f1eb14 service nova] Creating event network-changed:c3907648-f43c-43ba-9e60-96fe2de992af for instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 on hv-cinder-82880 Aug 30 14:49:31.418745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-be62058d-eaf6-4806-a123-c31529e2b3ad req-50aa0e14-c1b2-4f82-b465-8ac847f1eb14 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045235 Aug 30 14:49:31.419354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 327/671] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:31.850052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:31.850684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:31.858378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.858866 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.859294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.860020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.860474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.860892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:32.002924 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:32.011398 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c8ac924e-b50d-400f-a85c-2c89607cf895 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.165249 Aug 30 14:49:32.011961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 345/672] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:31 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:32.395491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:32.396205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:32.404782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:32.405226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:32.405727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:32.406748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:32.407287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:32.407848 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:32.557874 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:32.561310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:32.572564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:32.574179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:32.575919 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9b1d0c5c-d540-47e3-81e8-572274a1b3e3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.185406 Aug 30 14:49:32.576526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 328/673] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:32 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:33.033106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:33.033748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:33.041855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.042656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.043400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.044674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.045435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.046145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.267627 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:33.278852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e2434e35-97fc-4928-9f61-9cfb9849438f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.249224 Aug 30 14:49:33.279768 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 346/674] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:33 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:33.601641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:33.602681 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:33.613288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.614057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.614530 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.615284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.615771 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.616284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.776131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:33.787020 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:33.788473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:33.789755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0a6a844b-4f26-47e0-839a-81f4381f0f62 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.193646 Aug 30 14:49:33.790304 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 329/675] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:33 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:34.304045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:34.304904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:34.313032 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.313519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.313957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:34.314663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.315110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.315526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:34.490815 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:34.501003 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e935eee9-340c-4720-9274-441873986ac0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.201325 Aug 30 14:49:34.501591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 347/676] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:34 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:34.824372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:34.825130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:34.832119 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.832605 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.833032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:34.833733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.834189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.834609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:34.990336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:35.000751 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:35.002314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:35.003503 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8575c439-3252-4aa2-a204-ba99efeba876 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.183875 Aug 30 14:49:35.004097 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 330/677] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:34 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:35.522391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:35.523142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:35.530950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:35.531436 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:35.531865 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:35.532621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:35.533066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:35.533478 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:35.692658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:35.694993 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:35.702397 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a8e978cf-80cf-4da0-82be-569959fded02 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.183886 Aug 30 14:49:35.703012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 348/678] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:35 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:36.030396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:36.032096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:36.038534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:36.041329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=10 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:36.051162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:36.052241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:36.053405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:36.054645 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:36.055842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:36.057189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:36.404964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:36.415735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:36.419174 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:36.420733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-00bd4763-8118-4897-8546-eafc952fe394 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.396894 Aug 30 14:49:36.421302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 331/679] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:36 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:36.723787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:36.724477 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:36.727374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:36.737200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:36.738034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:36.738450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:36.739407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:36.739900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:36.740360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:37.163313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:37.174467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0a748b3f-fe92-4960-a7fd-73d58bf14b94 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.454831 Aug 30 14:49:37.175393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 349/680] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:36 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:37.464033 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:37.465494 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:37.473447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:37.474040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:37.474737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:37.475631 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:37.476340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:37.477068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:38.040350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:38.051689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:38.054468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:38.056371 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-89aff01f-7320-4d86-8b4f-91c3f0884569 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.597575 Aug 30 14:49:38.057345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 332/681] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:37 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:38.198839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:38.199913 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:38.209771 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:38.210382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:38.210860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:38.212364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:38.212848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:38.213280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:38.461517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:38.472031 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-657e931b-8f45-44c8-9865-4e570dc9f46b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.278421 Aug 30 14:49:38.472742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 350/682] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:38 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:39.079941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:39.080525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:39.087863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.088370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.088796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.089486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.089913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.090354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.232502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:39.241488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:39.243648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:39.244884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cc6bd69f-8a06-4b7a-8ff2-92048da7da42 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.169039 Aug 30 14:49:39.245455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 333/683] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:39 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:39.494686 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:39.495356 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:39.502433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.502916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.503383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.504091 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.504539 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.504961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.662472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:39.671489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a2970304-3d03-4f7b-8d2e-6b6a94ad7bac tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.180843 Aug 30 14:49:39.672077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 351/684] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:39 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:40.268710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:40.269413 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:40.276313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.276796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.277221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.277901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.278345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.278759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.422022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:40.434667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:40.436105 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:40.437352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c00f9554-a5f8-4393-95e8-0be56d9bdee9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.172648 Aug 30 14:49:40.437913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 334/685] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:40 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:40.693410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:40.694032 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:40.700857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.701338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.701763 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.702453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.702922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.703334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.872182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:40.880327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9c515b2a-f122-475b-b993-5109335301b5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.190833 Aug 30 14:49:40.880904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 352/686] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:40 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:41.462167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:41.463158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:41.471012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.471502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.471930 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:41.472649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.473084 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.473515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:41.618039 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:41.627365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:41.628868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:41.630022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-48f5341c-4908-4c2c-9b23-5aa08ae7b55a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.172784 Aug 30 14:49:41.630594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 335/687] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:41 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:41.902469 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:41.903110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:41.909900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.910399 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.910833 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:41.911537 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.911973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.912530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:42.056245 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:42.065985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-41bdb242-2274-46eb-a686-52e85d1d592f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.167258 Aug 30 14:49:42.066427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 353/688] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:41 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:42.654381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:42.654999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:42.662694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:42.663376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:42.663815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:42.664641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:42.665381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:42.665960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:42.816695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:42.826802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:42.828359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:42.829670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dd9b0075-4307-4204-917c-bc69335c97f7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.180326 Aug 30 14:49:42.830294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 336/689] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:42 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:43.064456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2012782132", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "networks": [{"uuid": "78d4cb0d-146e-41ec-b460-39f9fdf90955"}]}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:43.088182 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:43.088834 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:43.095947 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.096418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.096849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.097580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.098031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.098431 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.123235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] validate_networks() for [('78d4cb0d-146e-41ec-b460-39f9fdf90955', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:49:43.338610 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:43.347803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9737ca33-4a67-4873-94ea-321b4961f3f6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.263635 Aug 30 14:49:43.349093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 337/690] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:43 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:43.674704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:49:43.675117 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:49:43.675578 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:49:43.675979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:49:43.676437 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:49:43.687252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.687722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.688190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.688916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.689366 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.689781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.709154 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Getting quotas for project d29d875fc4d84f92801112d6d2accd13. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:49:43.715034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Getting quotas for user bf6b353833f14c3d819164e23374591e and project d29d875fc4d84f92801112d6d2accd13. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:49:43.729197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:49:43.731626 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:49:43.784423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-98becb29-3ccd-4937-8e99-b81cd0a280c4 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723763 Aug 30 14:49:43.785073 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 354/691] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:49:43.801206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-771ae9be-ac84-4f70-8f32-a58503d3bb7f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:43.802418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-771ae9be-ac84-4f70-8f32-a58503d3bb7f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:43.853869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:43.854481 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:43.861600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.862091 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.862703 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.863513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.863896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.864342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.893374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-771ae9be-ac84-4f70-8f32-a58503d3bb7f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:43.907202 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-771ae9be-ac84-4f70-8f32-a58503d3bb7f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1219 microversion: 2.1 time: 0.114011 Aug 30 14:49:43.908123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 338/692] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:43 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:44.044120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:44.054848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:44.056972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:44.058265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-88ae1f1e-1daa-4b2c-b92e-aec61d4990a3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.208759 Aug 30 14:49:44.059130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 355/693] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:43 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:44.376753 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:44.377558 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:44.379365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:44.386143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.386633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.387061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:44.387763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.388249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.388773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:44.537669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:44.547191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c307f780-1ae2-43a2-aa36-1e0b51dfad9b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.174364 Aug 30 14:49:44.547802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 339/694] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:44 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:44.944314 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:44.944885 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:44.952285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.952767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.953192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:44.953910 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.954347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.954791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.023483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:45.032664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1b321242-9a15-412e-8fa9-e89daba93eb8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1223 microversion: 2.1 time: 0.092498 Aug 30 14:49:45.033260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 356/695] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:44 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:45.081606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:45.082389 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:45.093838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.094657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.095160 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.096349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.096899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.097552 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.247072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:45.256950 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:45.258513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:45.259718 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b985f5b3-e165-45b9-93ce-f7876d75e8ba tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.182128 Aug 30 14:49:45.260325 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 340/696] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:45 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:45.571447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:45.572416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:45.578974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.579548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.580107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.580877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.581395 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.581889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.766785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:45.777201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c0d89d11-9c3e-43fa-ab4f-9424e82136d5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.209738 Aug 30 14:49:45.777974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 357/697] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:45 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:46.059447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:46.060406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:46.069072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.069556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.069988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.070909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.071620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.072085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.141179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:46.150505 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1073d69d-8209-49ab-9bc4-38f8f43f9fef tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.099136 Aug 30 14:49:46.151166 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 341/698] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:46 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:46.283935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:46.284678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:46.292799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.293266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.293714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.294494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.294951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.295366 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.739435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:46.755351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:46.758185 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:46.760352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3f5ae82e-762f-444c-bce5-9dd7485a400f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.480795 Aug 30 14:49:46.762406 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 358/699] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:46 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:46.810344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:46.811012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:46.817504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.817963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.818419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.819125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.819573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.819992 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.976138 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:46.985028 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d8b0d847-18e3-404d-a14d-8556cd60b99e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.179318 Aug 30 14:49:46.985621 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 342/700] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:46 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:47.171879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:47.172714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:47.179556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.180222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.181075 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.181394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.182209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.182625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.259832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:47.268870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-59f8c4e4-bace-49c9-87bd-c59770541c3d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.101817 Aug 30 14:49:47.269451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 359/701] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:47 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:47.784617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:47.785233 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:47.791992 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.792518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.792934 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.793731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.794054 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.794479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.966115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:47.974708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:47.976136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:47.977392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4d3852b7-4884-436c-b1cb-a9c2263589e0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.196766 Aug 30 14:49:47.977983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 343/702] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:47 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:48.019923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:48.021173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:48.028684 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.029174 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.029603 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.030291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.030734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.031156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.187962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:48.197758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fcaf064f-c8e0-4ff6-b882-8f4fe5ac594c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.184679 Aug 30 14:49:48.198693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 360/703] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:48 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:48.290741 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:48.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:48.297795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.298285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.298720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.299422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.299870 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.300325 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.368270 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:48.377195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c9741cae-466c-498c-b13d-b51e4dd126f5 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.090852 Aug 30 14:49:48.377869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 344/704] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:48 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:49.000971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:49.001739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:49.008634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.009274 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.009700 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.010403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.010845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.011262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.151676 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:49.165316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:49.166762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:49.167965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-dcdb9202-9e75-43c9-ae48-48778502726b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.171154 Aug 30 14:49:49.168534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 361/705] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:48 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:49.223642 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:49.225175 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:49.234329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.234923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.235409 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.236248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.236821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.237317 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.391563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:49.399517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:49.400081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:49.403229 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-118c4671-0dd8-43e0-a17b-63f86819cbab tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.183469 Aug 30 14:49:49.403903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 345/706] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:49 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:49.406309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.406792 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.407220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.407911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.408390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.408802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.482526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:49.491593 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1c3b6e3f-3d25-424e-bba9-2ea96cac6c8b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.096220 Aug 30 14:49:49.492227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 362/707] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:49 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:50.194639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:50.195493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:50.207301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.207823 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.208447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.208985 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.209429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.209844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.226265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:50.401568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-d0a96453-782b-4c79-b5e6-5c00a148c357 req-c3f2c2ef-c034-41f6-8be8-7509e079f6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a8e249-ce8d-48bd-af4e-ae32d0eed382", "name": "network-vif-plugged", "status": "completed", "tag": "c3907648-f43c-43ba-9e60-96fe2de992af"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:49:50.412682 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:50.435330 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:50.441513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-d0a96453-782b-4c79-b5e6-5c00a148c357 req-c3f2c2ef-c034-41f6-8be8-7509e079f6ab service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.442868 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-d0a96453-782b-4c79-b5e6-5c00a148c357 req-c3f2c2ef-c034-41f6-8be8-7509e079f6ab service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.443936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:50.444777 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-d0a96453-782b-4c79-b5e6-5c00a148c357 req-c3f2c2ef-c034-41f6-8be8-7509e079f6ab service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.459678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:50.465827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1bdbf443-82c5-4806-a00d-79281d10e8c8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.275978 Aug 30 14:49:50.481350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 346/708] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:50 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:50.482157 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-d0a96453-782b-4c79-b5e6-5c00a148c357 req-c3f2c2ef-c034-41f6-8be8-7509e079f6ab service nova] Creating event network-vif-plugged:c3907648-f43c-43ba-9e60-96fe2de992af for instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 on hv-cinder-82880 Aug 30 14:49:50.489668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-d0a96453-782b-4c79-b5e6-5c00a148c357 req-c3f2c2ef-c034-41f6-8be8-7509e079f6ab service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097003 Aug 30 14:49:50.491002 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 363/709] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:49:50.499232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:50.502063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:50.516248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:50.522354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:50.524941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.526274 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.528147 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.533792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.535185 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.538816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.544157 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.545140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.546002 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.547462 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.548376 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.549199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.670084 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:50.680853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7b5c596d-376a-4ca7-85ca-56abe4bfb26f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.171057 Aug 30 14:49:50.682208 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 364/710] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:50 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:50.782475 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:50.793487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1edee7ba-1b03-4a9d-b040-e1ac5106ac30 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.311548 Aug 30 14:49:50.794346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 347/711] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:50 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:51.521797 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:51.522531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:51.530333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.530823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.531256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.531973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.532459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.532897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.694279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:51.704726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:51.706373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:51.707719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-aaaf36a6-12c7-48eb-b0bc-c2f6c4366f5e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.190195 Aug 30 14:49:51.708558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 365/712] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:51 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:51.717247 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:51.718258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:51.727743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.728186 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.728689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.729577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.730299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.730791 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.808635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:51.817809 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dd6a260c-928c-469b-9fd4-166a289bd9d6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.104758 Aug 30 14:49:51.819752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 348/713] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:51 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:51.825180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:51.826736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:51.840097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.841064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.841794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.843001 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.843794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.844546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.003164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:52.006445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:52.015835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b6305ee1-f127-4f5d-b1b4-40a1dafbedbd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.198709 Aug 30 14:49:52.016682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 366/714] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:51 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:52.735897 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:52.737022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:52.749153 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.750022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.750790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.752025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.752867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.753560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.845016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:52.847339 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:52.860516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.861845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.862618 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.863895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.865015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.865728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.989989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:53.002052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c9f93f46-302d-4944-a61a-4ba8a6b071c7 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.165497 Aug 30 14:49:53.002649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 367/715] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:52 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:53.013168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:53.024739 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:53.026405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:53.027658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-81c2c9c8-2a7d-43a2-9711-93568466de55 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.298958 Aug 30 14:49:53.028354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 349/716] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:52 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:53.048525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:53.049738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:53.062477 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:53.063284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:53.064020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:53.065229 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:53.066001 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:53.066706 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:53.282207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:53.294552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-44fa5739-cf73-474a-afe8-55c25b7db085 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.253446 Aug 30 14:49:53.295219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 368/717] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:53 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:54.034470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:54.035211 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:54.037608 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:54.044173 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.044841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.045092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.045815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.046262 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.046685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.052911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:54.054415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:54.059382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:54.060723 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:54.074870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.075635 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.076337 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.077220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.077801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.078352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.158162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:54.172594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-eac60fc6-5d4f-4276-848c-b0bd71410367 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.140524 Aug 30 14:49:54.185765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 350/718] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:54 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:54.301079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:54.316435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:54.317948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:54.319254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5e62a532-b0ca-4ed8-9d83-d27b81f06229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.271302 Aug 30 14:49:54.319915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 369/719] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:54 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:54.333872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:54.334973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:54.346746 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.347613 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.348387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.349650 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.350663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.351381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.558053 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:54.575517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-567c5760-4358-4233-9aba-25d8a15c0664 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.248467 Aug 30 14:49:54.576639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 351/720] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:54 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:55.208527 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:55.209269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:55.217540 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.218073 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.218518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.219308 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.219826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.220341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.296791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:55.311609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-743bcbe2-50b4-40d8-bbe0-e6854f728aae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.107132 Aug 30 14:49:55.312363 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 370/721] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:55 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:55.349252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:55.349975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:55.360947 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.361755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.362464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.363664 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.364473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.365182 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.535158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:55.552151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:55.555273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:55.557400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b74a8c81-b58b-47d8-97c9-49a14dc47388 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.213501 Aug 30 14:49:55.557996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 352/722] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:55 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:49:55.605447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:55.606069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:55.614119 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.614641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.615077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.615780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.616293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.616693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.813755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:55.827942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a8e619cf-653e-46ea-8ab1-6bf7bcb417ae tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.226260 Aug 30 14:49:55.830148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 371/723] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:55 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:56.338652 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:56.340315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:56.352185 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.352990 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.353137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:56.353858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.356890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.356890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:56.429548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:56.440326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9452e43b-878d-45ea-a648-cf9906ef6914 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.109677 Aug 30 14:49:56.440765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 353/724] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:56 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:56.583012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:56.583715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:56.591303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.591695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.592164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:56.592866 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.593314 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.593732 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:56.776043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:56.786645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:56.788097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:56.789398 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5e830323-b64a-4ca8-93e7-ab8f3451db04 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.210644 Aug 30 14:49:56.802029 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 372/725] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:56 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:56.859447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:56.860034 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:56.866815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.867419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.867855 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:56.868637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.869098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.869522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.033953 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:57.049141 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-97cb2076-d8b5-49f4-a711-139de90c0aa6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.193535 Aug 30 14:49:57.049938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 354/726] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:56 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:49:57.463960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:57.464612 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:57.471390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.472398 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.473246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.474592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.475604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.476543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.562318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:57.573064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f35d3b34-e3a6-49a2-b171-07939ab481b1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.114762 Aug 30 14:49:57.573649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 373/727] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:57 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:57.815469 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:57.816191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:57.823125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.823604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.824056 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.824803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.825239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.825649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.980463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:57.991881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:57.993435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:57.994649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-52db8e99-26fb-4717-a159-8ac7cbcf2aa7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.183367 Aug 30 14:49:57.995196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 355/728] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:57 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:58.074751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:58.075392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:58.082014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.082492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.082915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.083610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.084081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.084500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.226848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:58.238155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6f7e0d0d-955d-4dc0-9937-81d5b052f577 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.167647 Aug 30 14:49:58.238916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 374/729] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:58 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:58.594967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:58.595579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:58.602114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.602716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.603246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.603968 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.604453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.604868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.678320 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:58.687504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3d923ca4-d463-4bc4-8f7b-54b811012b45 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.096398 Aug 30 14:49:58.688310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 356/730] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:58 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:59.018077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:59.018694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:59.026264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.026734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.027165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.027873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.028352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.028740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.173529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:59.184888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:59.186316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:59.187500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-eb3e2792-2ade-424e-bfc1-d7498d540482 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.173449 Aug 30 14:49:59.188379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 375/731] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:49:59 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:49:59.263918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:59.264651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:59.272927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.273304 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.273865 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.274578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.275024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.275440 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.446163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:59.455386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a68b4052-7cdc-4c65-a41a-dc47df6da178 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.195767 Aug 30 14:49:59.457198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 357/732] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:59 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:49:59.709390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:59.709993 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:59.716576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.717048 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.717469 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.718154 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.718593 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.719006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.807051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:49:59.815144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bc241c7d-8f31-4c4f-a090-1fc55422fc47 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.109824 Aug 30 14:49:59.815721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 376/733] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:49:59 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:50:00.211737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:00.212472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:00.219447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.219963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.220421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.221122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.221573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.221989 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.388692 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:00.401007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:00.402029 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:00.403275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e44971dd-ea62-4aff-a803-6d8b58b1506a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.195872 Aug 30 14:50:00.403833 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 358/734] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:00 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:00.478213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:00.478843 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:00.486193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.486682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.487189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.487914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.488396 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.488854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.654583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:00.662943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b1b82346-bd3f-487f-9604-84d3f04d03a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.188692 Aug 30 14:50:00.664053 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 377/735] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:00 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:00.838454 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:00.839059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:00.845572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.846068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.846504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.847214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.847668 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.848133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.919042 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:00.926837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5eb48881-679c-4dba-a32b-7a8760abee3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.093000 Aug 30 14:50:00.927413 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 359/736] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:00 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:01.430555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:01.431962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:01.440696 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.441336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.441940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.442891 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.443501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.444120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.590957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:01.600512 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:01.602127 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:01.603570 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-830c1af1-d845-41fb-b56e-7960dbea6d37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.180133 Aug 30 14:50:01.604152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 378/737] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:01 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:01.689870 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:01.690433 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:01.697605 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.697869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.698237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.698948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.699401 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.699821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.846520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:01.858170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dfa4b820-fb5d-46c6-9a60-a1cdd8706adb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.172216 Aug 30 14:50:01.858917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 360/738] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:01 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:01.951962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:01.952833 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:01.960652 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.961352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.962224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.962944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.963394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.963817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.036256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:02.045585 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cc6f0957-24dc-4d6b-a637-97aa833919b3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.100232 Aug 30 14:50:02.046416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 379/739] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:01 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:50:02.626893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:02.627501 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:02.634157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.634655 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.635130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.635786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.636259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.636676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.782402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:02.792967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:02.794434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:02.795625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-641a649e-fa7e-48cd-b467-c72ca154f0be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.172633 Aug 30 14:50:02.796267 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 361/740] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:02 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:02.879112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:02.879775 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:02.887942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.888772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.889431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.890232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.890683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.891096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.033207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:03.041568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cff05364-5580-4551-9cae-d2e7a895cdc6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.166259 Aug 30 14:50:03.042110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 380/741] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:02 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:03.068547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:03.069151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:03.075741 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.076269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.076697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.077391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.077836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.078248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.146879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:03.155538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fe587f6f-5512-4770-92b5-764aa824259f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.091136 Aug 30 14:50:03.156160 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 362/742] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:03 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:03.821413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:03.821934 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:03.828705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.829301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.829789 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.830553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.831042 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.831500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.971845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:03.981383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:03.982800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:03.983978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ec769693-06c4-4685-a2f3-4362864ea839 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.167278 Aug 30 14:50:03.984558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 381/743] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:03 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:04.063388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:04.064059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:04.071298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.071879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.072274 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.072987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.073434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.073856 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.076860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:04.177260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:04.177917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:04.185125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.185614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.186046 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.186757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.187208 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.187628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.215273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:04.223270 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b78e32ca-4d86-4b77-8c7f-9b74dfbc6e76 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.163916 Aug 30 14:50:04.223857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 363/744] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:04 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:04.252900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:04.261687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-11b1a618-3e6d-46ce-bec3-6eca3417ff2f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.088503 Aug 30 14:50:04.262246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 382/745] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:04 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:05.007166 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:05.007802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:05.014356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.014836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.015261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.015955 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.016419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.016869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.169882 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:05.179795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:05.181675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:05.182884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cb13035d-c183-44cc-8eb7-6e41c69da400 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.179714 Aug 30 14:50:05.183455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 364/746] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:05 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:05.245162 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:05.245805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:05.252737 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.254363 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.254792 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.255513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.255958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.256404 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.273512 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:05.283562 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:05.284482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:05.291885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.292596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.293342 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.295170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.295432 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.296201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.409169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:05.423438 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-14eb51d4-f6b6-49b8-b0e4-7ad1fb78c6d8 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.143556 Aug 30 14:50:05.424619 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 365/747] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:05 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:50:05.450411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:05.465896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-43bfa895-24a8-4b32-8689-4ebeab1e3c61 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.224963 Aug 30 14:50:05.466537 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 383/748] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:05 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:06.206528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:06.207198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:06.214949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.215442 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.215923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.216832 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.217262 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.217736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.369181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:06.378836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:06.380305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:06.381515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-72daf0fd-00bd-40d7-beb8-2fb9018f82d2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.179067 Aug 30 14:50:06.382112 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 366/749] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:06 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:06.459340 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:06.460034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:06.467313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.468361 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.468989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.469845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.470356 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.470820 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.487227 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:06.488898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:06.496539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.497029 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.497466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.498202 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.498678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.499081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.537858 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:06.546840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-12be3364-0279-4979-980a-d0df663ad12a tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.091861 Aug 30 14:50:06.547423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 384/750] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:06 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:06.666685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:06.675226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0425cd4d-4684-4290-8199-a563fd665541 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.192008 Aug 30 14:50:06.675817 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 367/751] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:06 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:50:07.406013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:07.406922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:07.414448 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.415049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.415489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.416248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.416698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.417125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.568981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:07.569983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:07.571352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:07.577369 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.577864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.578292 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.579006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.579453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.579841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.584307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:07.587422 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:07.589507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2a73f616-1c87-4ce2-8eb4-8590f2dd3aac tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.188049 Aug 30 14:50:07.590266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 385/752] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:07 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:07.658396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:07.668107 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c10f56af-dcd5-4218-83bd-91169a0b49db tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.103236 Aug 30 14:50:07.668917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 368/753] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:07 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:50:07.700069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:07.700767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:07.709456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.709918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.710366 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.711334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.712055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.712492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.869053 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:07.877674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0d3f1f81-ba77-485b-b820-5a0156942122 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.182955 Aug 30 14:50:07.878270 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 386/754] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:07 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:08.613196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:08.613983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:08.620996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.621511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.621948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.622648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.623070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.623521 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.692128 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:08.692737 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:08.700198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.702553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.702553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.702553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.702553 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.702866 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.784631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:08.793288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6c818fb0-4a07-433e-b3b9-c116e008fcf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.104973 Aug 30 14:50:08.793893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 387/755] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:08 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:08.806902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:08.816374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:08.817798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:08.818979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-df285593-31db-41f9-9011-834ba3879ec6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.209833 Aug 30 14:50:08.819581 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 369/756] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:08 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:08.899138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:08.899897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:08.911295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.911895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.912452 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.913220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.914221 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.914388 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.110852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:09.119976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d634f9d4-193c-4418-9fc4-0426fe4f02c9 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.224823 Aug 30 14:50:09.120650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 388/757] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:08 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:09.816619 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:09.817401 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:09.826801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.827496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.827960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.828710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.829160 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.829610 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.846678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:09.848183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:09.855950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.856510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.856948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.857677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.858109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.858525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.899986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:09.908472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e4721b42-4681-491a-ba97-bdb315264121 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.096805 Aug 30 14:50:09.909658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 370/758] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:09 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:10.016832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:10.027894 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:10.029439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:10.030727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3d8a5de9-507d-4fd5-8b61-b524522fa03d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.191821 Aug 30 14:50:10.031276 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 389/759] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:09 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:50:10.141822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:10.142366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:10.149093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.149264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.149902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:10.150617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.151063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.151476 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:10.300955 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:10.309437 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-125f84a6-3b7e-44a7-889e-661fcb3e8484 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.171546 Aug 30 14:50:10.310001 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 371/760] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:10 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:10.931471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:10.932379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:10.939322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.939884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.940489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:10.941240 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.941758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.942222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.008260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:11.016318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2fc7cfc2-4dfb-4cb9-a7ea-7b18507d1615 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1215 microversion: 2.1 time: 0.089167 Aug 30 14:50:11.016907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 390/761] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:10 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:11.059388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:11.060160 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:11.067508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.069006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.069436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.070205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.070659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.071074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.222639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:11.236336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:11.239208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:11.241374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-46570e88-5fed-4580-b800-024886438375 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.187126 Aug 30 14:50:11.242446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 372/762] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:11 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:11.331004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:11.331613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:11.338027 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.338509 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.338938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.339629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.340106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.340524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.493900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:11.502808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1dcc4420-850d-4b30-8edb-7176f1df5e7a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1365 microversion: 2.1 time: 0.175665 Aug 30 14:50:11.503392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 391/763] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:11 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:12.048816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:12.049546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:12.057552 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.058321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.058804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.059510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.060124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.060389 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.128529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:12.141647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-74e5fef4-4e24-4761-a2fe-9ea50daa05ae tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1271 microversion: 2.1 time: 0.097597 Aug 30 14:50:12.142582 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 373/764] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:12 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:12.265157 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:12.265733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:12.272739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.273259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.273707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.274389 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.274830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.275246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.428311 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:12.438948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:12.440597 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:12.441825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6fa88266-1375-42c7-83c2-14e7de6b43a4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.180675 Aug 30 14:50:12.442387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 392/765] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:12 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:12.524375 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:12.525654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:12.532821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.533957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.534425 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.535181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.535845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.536284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.772358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:12.781357 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6df921d0-ba3a-4229-8e0b-2ff2f53549c4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1555 microversion: 2.1 time: 0.261145 Aug 30 14:50:12.781952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 374/766] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:12 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:12.804072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:12.804982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:12.812714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.813298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.813670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.814383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.814839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.815259 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.950098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-09cc2949-f0f1-446f-a3bb-0a1228e9f7b1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149909 Aug 30 14:50:12.950798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 393/767] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:50:12 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:13.168499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:13.169107 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:13.176908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.176908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.176908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:13.177645 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.178012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.179120 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:13.302514 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:13.311550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cd9210ff-702d-49dd-affc-58b604ff5bf6 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1277 microversion: 2.1 time: 0.148407 Aug 30 14:50:13.312398 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 375/768] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:13 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:13.471242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:13.471893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:13.478361 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.478848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.479275 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:13.479974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.480450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.480869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:14.069050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:14.082761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:14.085141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:14.086750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5da26a59-ef13-493b-aff0-da6cd44927e1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.620161 Aug 30 14:50:14.087709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 394/769] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:13 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:14.334592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:14.335742 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:14.343093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:14.343748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:14.344339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:14.345049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:14.345506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:14.345913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:14.701840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:14.711393 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8386afa0-a9de-4d9a-87ff-ff12243ce45e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.380851 Aug 30 14:50:14.712014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 376/770] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:14 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:15.096719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-e807cf02-c619-4c22-99b1-0491ec7cbfcd req-bdb95a04-e50e-4720-8dc0-2e1df70817a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a8e249-ce8d-48bd-af4e-ae32d0eed382", "tag": "c3907648-f43c-43ba-9e60-96fe2de992af"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:50:15.114414 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:15.115478 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:15.123232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=76 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:15.136499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-e807cf02-c619-4c22-99b1-0491ec7cbfcd req-bdb95a04-e50e-4720-8dc0-2e1df70817a5 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.137499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-e807cf02-c619-4c22-99b1-0491ec7cbfcd req-bdb95a04-e50e-4720-8dc0-2e1df70817a5 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.137895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-e807cf02-c619-4c22-99b1-0491ec7cbfcd req-bdb95a04-e50e-4720-8dc0-2e1df70817a5 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.143540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.144313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.144760 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.145589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.146045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.146454 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.153837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-e807cf02-c619-4c22-99b1-0491ec7cbfcd req-bdb95a04-e50e-4720-8dc0-2e1df70817a5 service nova] Creating event network-changed:c3907648-f43c-43ba-9e60-96fe2de992af for instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 on hv-cinder-82880 Aug 30 14:50:15.159516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-e807cf02-c619-4c22-99b1-0491ec7cbfcd req-bdb95a04-e50e-4720-8dc0-2e1df70817a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136983 Aug 30 14:50:15.160449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 395/771] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:15.340611 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:15.351895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:15.353473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:15.354708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-274a8458-54ba-4642-ab5f-71ba0e50a347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.247372 Aug 30 14:50:15.355276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 377/772] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:15 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:15.736337 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:15.737056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:15.744582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.745068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.745501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.746212 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.746666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.747085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.892897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:15.902695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-dfb188d7-974c-4d1e-8868-853b5fe9eb9f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.172697 Aug 30 14:50:15.903474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 396/773] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:15 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:16.378380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:16.379010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:16.386370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:16.387042 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:16.387485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:16.388221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:16.388669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:16.389092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:16.712465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:16.721737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:16.723158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:16.724369 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2e7c6ad9-dccb-4523-8150-502ecb5f3e41 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.349980 Aug 30 14:50:16.724920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 378/774] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:16 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:16.925801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:16.926629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:16.933985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:16.934484 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:16.934919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:16.935621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:16.936111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:16.936535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.277198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-24084ed9-6f44-4b0f-811c-0af8ad26085d req-4ec375e3-6438-4ad4-9ab7-ae5ee8a0f76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1dc1131-1052-471f-8114-3159c2104a4b", "tag": "948a3811-aa2b-4b0f-9d9a-cdebab49d579"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:50:17.287314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-24084ed9-6f44-4b0f-811c-0af8ad26085d req-4ec375e3-6438-4ad4-9ab7-ae5ee8a0f76d service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:17.287853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-24084ed9-6f44-4b0f-811c-0af8ad26085d req-4ec375e3-6438-4ad4-9ab7-ae5ee8a0f76d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:17.288335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-24084ed9-6f44-4b0f-811c-0af8ad26085d req-4ec375e3-6438-4ad4-9ab7-ae5ee8a0f76d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.300737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-24084ed9-6f44-4b0f-811c-0af8ad26085d req-4ec375e3-6438-4ad4-9ab7-ae5ee8a0f76d service nova] Creating event network-changed:948a3811-aa2b-4b0f-9d9a-cdebab49d579 for instance a1dc1131-1052-471f-8114-3159c2104a4b on hv-cinder-82880 Aug 30 14:50:17.307924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-24084ed9-6f44-4b0f-811c-0af8ad26085d req-4ec375e3-6438-4ad4-9ab7-ae5ee8a0f76d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035267 Aug 30 14:50:17.308746 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 379/775] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:50:17.356438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:17.364907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-32134fb4-ff78-49cc-b731-87c7b6c5adab tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.442993 Aug 30 14:50:17.365678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 397/776] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:16 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:17.750324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:17.751055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:17.758264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:17.758731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:17.759157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.759860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:17.760345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:17.760754 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.776724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:17.900714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:17.914012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:17.915680 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:17.917475 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e6c97aee-1c87-4d92-afc0-8b435a2e0b07 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.172934 Aug 30 14:50:17.918281 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 380/777] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:17 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:18.386297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:18.387002 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:18.393897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.394387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.394900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:18.395658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.396141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.396560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:18.540124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:18.552791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8ecef65f-3f9a-4a3d-9448-ed6f5058a446 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.170123 Aug 30 14:50:18.553453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 398/778] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:18 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:18.944358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:18.945093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:18.951893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.952420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.952853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:18.953556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.953999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.954415 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:19.100811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:19.116598 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:19.119698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:19.121807 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1c0ce7da-8f1f-4a5e-a76a-8727606d1ce9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.181155 Aug 30 14:50:19.122864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 381/779] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:18 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:19.575486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:19.576105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:19.583175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:19.583655 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:19.584269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:19.584965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:19.585410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:19.585904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:19.829102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:19.837091 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8ef07018-9519-4993-8011-4a679e8ce9be tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.265455 Aug 30 14:50:19.838013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 399/780] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:19 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:20.147124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:20.147933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:20.156042 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.156637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.157607 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.157905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.158839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.159255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.389468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:20.399879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:20.401518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:20.402817 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b1a2bd0b-83d2-4ece-8899-b0da2f2c5a1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.259867 Aug 30 14:50:20.403462 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 382/781] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:20 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:20.705884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-38bffa65-8ecb-4b79-b2be-ef11bb6f97c1 req-d9931794-0422-4a04-96d8-55881e60e716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1622c2-5c2a-4656-b39c-0f2f520fcf52", "name": "network-vif-plugged", "status": "completed", "tag": "cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:50:20.711428 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=74 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:20.717618 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-38bffa65-8ecb-4b79-b2be-ef11bb6f97c1 req-d9931794-0422-4a04-96d8-55881e60e716 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.718098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-38bffa65-8ecb-4b79-b2be-ef11bb6f97c1 req-d9931794-0422-4a04-96d8-55881e60e716 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.718524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-38bffa65-8ecb-4b79-b2be-ef11bb6f97c1 req-d9931794-0422-4a04-96d8-55881e60e716 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.733391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-38bffa65-8ecb-4b79-b2be-ef11bb6f97c1 req-d9931794-0422-4a04-96d8-55881e60e716 service nova] Creating event network-vif-plugged:cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1 for instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 on hv-cinder-82880 Aug 30 14:50:20.738961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-38bffa65-8ecb-4b79-b2be-ef11bb6f97c1 req-d9931794-0422-4a04-96d8-55881e60e716 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102079 Aug 30 14:50:20.739572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 400/782] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:20.861893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:20.863032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:20.873993 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.874824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.875548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.876871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.877686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.878419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:21.026585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:21.034798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8bfa978f-3e8a-446f-a5a0-6a86ff8cb0f3 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.180063 Aug 30 14:50:21.035402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 383/783] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:20 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:21.430289 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:21.431456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:21.440051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:21.440599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:21.440963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:21.441685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:21.442169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:21.442632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:21.626184 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:21.628625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:21.639290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:21.640663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:21.641913 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f94b7f88-4f67-472d-ab7d-9d141c0ff02b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.216777 Aug 30 14:50:21.642474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 401/784] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:21 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:22.057108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:22.057814 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:22.064475 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.064956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.065376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.066079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.066551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.066938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.215585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:22.225776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1ca806b0-26aa-4f78-80ec-fac8d78d141d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.173382 Aug 30 14:50:22.226592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 384/785] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:22 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:22.674534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:22.675641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:22.688941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.689751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.690498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.691650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.692416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.693148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.856058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:22.865830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:22.867429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:22.868664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-74368ffb-2b12-4b13-8fff-db386bba3ee5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.201898 Aug 30 14:50:22.869215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 402/786] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:22 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:23.247719 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:23.248588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:23.256130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.256623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.257062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:23.257920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.258426 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.258918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:23.413141 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:23.421554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f775f673-8887-44b3-beae-783e7f4a85a0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.178051 Aug 30 14:50:23.422139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 385/787] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:23 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:23.892571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:23.893165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:23.900577 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.901078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.901584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:23.902211 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.902666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.903081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:24.050518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:24.061519 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:24.063039 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:24.064387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f475bccc-e371-4ca4-9c44-f0c525e236f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.175836 Aug 30 14:50:24.065068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 403/788] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:23 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:24.445613 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:24.447293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:24.458107 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:24.458909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:24.459683 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:24.461710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:24.462489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:24.463201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:24.667227 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:24.675756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4509ce3c-0bfc-42d5-89cc-1ce2307c692d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.236520 Aug 30 14:50:24.676872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 386/789] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:24 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:24.996645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-74050222-18a5-4bdd-b343-23ffe98579ea req-42b8f785-d45b-4cab-a209-99369402300f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1dc1131-1052-471f-8114-3159c2104a4b", "name": "network-vif-plugged", "status": "completed", "tag": "948a3811-aa2b-4b0f-9d9a-cdebab49d579"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:50:25.008815 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-74050222-18a5-4bdd-b343-23ffe98579ea req-42b8f785-d45b-4cab-a209-99369402300f service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.009657 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-74050222-18a5-4bdd-b343-23ffe98579ea req-42b8f785-d45b-4cab-a209-99369402300f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.010168 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-74050222-18a5-4bdd-b343-23ffe98579ea req-42b8f785-d45b-4cab-a209-99369402300f service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.022694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-74050222-18a5-4bdd-b343-23ffe98579ea req-42b8f785-d45b-4cab-a209-99369402300f service nova] Creating event network-vif-plugged:948a3811-aa2b-4b0f-9d9a-cdebab49d579 for instance a1dc1131-1052-471f-8114-3159c2104a4b on hv-cinder-82880 Aug 30 14:50:25.028158 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-74050222-18a5-4bdd-b343-23ffe98579ea req-42b8f785-d45b-4cab-a209-99369402300f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037270 Aug 30 14:50:25.028996 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 404/790] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:25.091581 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:25.092861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:25.099701 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.100648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.101342 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.102800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.103459 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.103889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.300329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:25.316902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:25.319680 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:25.321931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7a625514-182d-44de-99a5-5fadae49aa97 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1807 microversion: 2.20 time: 0.236284 Aug 30 14:50:25.322890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 387/791] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:25 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:25.701518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:25.702632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:25.714491 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.715353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.716049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.717129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.717875 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.718540 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.877438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:25.886210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2b8a891f-988c-4982-a169-fdfb0a5feb69 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.191525 Aug 30 14:50:25.886722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 405/792] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:25 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:26.359155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:26.359794 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:26.366888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.367511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.368158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:26.368881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.369329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.369749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:26.515201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:26.524932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:26.526445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:26.527677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a3e5bd2c-813c-4005-8a4b-ff29240d5ab1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1794 microversion: 2.20 time: 0.172635 Aug 30 14:50:26.528291 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 388/793] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:50:26 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1794 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:50:26.919709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:26.920426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:26.927721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.928232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.928688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:26.930065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.930216 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.930578 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:27.096179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:27.122736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-83b523bd-3a60-468f-9479-24c44650f906 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.207051 Aug 30 14:50:27.123488 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 406/794] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:26 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:28.144445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:28.145385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:28.153636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:28.154255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:28.154503 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:28.155219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:28.155666 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:28.156116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:28.312776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:28.322496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9b2deb06-1765-4bf7-9e78-08891421004b tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1319 microversion: 2.1 time: 0.182058 Aug 30 14:50:28.323097 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 389/795] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:28 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:29.346813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:29.347486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:29.355870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.356646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.357263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.358346 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.358917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.359402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.537544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:29.545958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-96b7bdee-b3af-4f2a-b660-ac272eb8979d tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1508 microversion: 2.1 time: 0.203072 Aug 30 14:50:29.546558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 407/796] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:29 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:29.579248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c036fbc8-a058-4283-854d-b49fedb1070f", "device": "/dev/sdb"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:50:29.582373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:29.589854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.590324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.590765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.591474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.591948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.592371 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.938874 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ca0a1e30-3906-4c86-a58c-8f69d789047f tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "POST /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369210 Aug 30 14:50:29.939772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 390/797] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:50:29 2022] POST /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b/os-volume_attachments => generated 194 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:55.750541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:55.751364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:55.754010 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=15 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:55.754854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=33 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:55.761201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:55.761693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:55.762116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:55.762824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:55.763258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:55.763688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:56.021081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lazy-loading 'services' on Instance uuid a1dc1131-1052-471f-8114-3159c2104a4b {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:50:56.104480 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9dac6dfd-85fc-453c-9ebe-1453fe579340 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b/os-volume_attachments/c036fbc8-a058-4283-854d-b49fedb1070f" status: 202 len: 0 microversion: 2.1 time: 0.357902 Aug 30 14:50:56.105359 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 408/798] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:50:55 2022] DELETE /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b/os-volume_attachments/c036fbc8-a058-4283-854d-b49fedb1070f => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:50:58.313049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:58.313686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:58.316634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=27 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:58.317299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:58.325738 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.326225 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.326659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.327369 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.327816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.328258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.370438 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:50:58.487896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ad3bb43e-2aa8-4b28-a02c-c98329807f8e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 204 len: 0 microversion: 2.1 time: 0.178633 Aug 30 14:50:58.488873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 391/799] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:50:58 2022] DELETE /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:50:58.503167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:58.504442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:58.513175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.513668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.514097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.514787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.515231 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.515637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.667599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:58.676137 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-728c5824-b312-46b8-b156-1aa70b04bed1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1514 microversion: 2.1 time: 0.181683 Aug 30 14:50:58.676795 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 409/800] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:58 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:50:58.809385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42adbeb6-046f-4b08-8321-f3a6ea551af4"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:50:58.812171 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:58.818694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.819176 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.819601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.820331 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.821376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.821376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:59.699120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:59.699825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:59.706670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:59.707150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:59.707574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:59.708286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:59.708747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:59.709159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:59.882269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:50:59.893640 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b81800fa-bcd9-4cbd-a7ed-bd4a08b458e0 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1514 microversion: 2.1 time: 0.198395 Aug 30 14:50:59.894329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 410/801] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:50:59 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:51:00.703871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3ebb2691-5318-4240-865a-9f1fe6e16c1a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.004517 Aug 30 14:51:00.704584 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 392/802] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:50:58 2022] POST /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments => generated 194 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:00.927344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:00.928494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:00.943524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:00.944042 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:00.944479 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:00.945193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:00.945732 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:00.946156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:01.088751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:01.096868 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0e2e72e4-4261-40a3-836e-165b18b6a1f1 tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1514 microversion: 2.1 time: 0.175861 Aug 30 14:51:01.097449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 411/803] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:00 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:51:01.775945 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-f5ad055e-c78d-40ec-b3df-40179dbcc1f6 req-ab1f50bd-25ec-45fb-96a9-ef4f6feecd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1dc1131-1052-471f-8114-3159c2104a4b", "name": "network-vif-deleted", "tag": "948a3811-aa2b-4b0f-9d9a-cdebab49d579"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:01.786963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f5ad055e-c78d-40ec-b3df-40179dbcc1f6 req-ab1f50bd-25ec-45fb-96a9-ef4f6feecd9b service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:01.787280 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f5ad055e-c78d-40ec-b3df-40179dbcc1f6 req-ab1f50bd-25ec-45fb-96a9-ef4f6feecd9b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:01.787745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f5ad055e-c78d-40ec-b3df-40179dbcc1f6 req-ab1f50bd-25ec-45fb-96a9-ef4f6feecd9b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:01.806803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-f5ad055e-c78d-40ec-b3df-40179dbcc1f6 req-ab1f50bd-25ec-45fb-96a9-ef4f6feecd9b service nova] Creating event network-vif-deleted:948a3811-aa2b-4b0f-9d9a-cdebab49d579 for instance a1dc1131-1052-471f-8114-3159c2104a4b on hv-cinder-82880 Aug 30 14:51:01.813067 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-f5ad055e-c78d-40ec-b3df-40179dbcc1f6 req-ab1f50bd-25ec-45fb-96a9-ef4f6feecd9b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042516 Aug 30 14:51:01.813665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 393/804] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:02.118488 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:02.118942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:02.126948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:02.127444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:02.127907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:02.128664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:02.129120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:02.129544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:02.167253 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:02.167733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:02.168198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:02.168625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lazy-loading 'fault' on Instance uuid a1dc1131-1052-471f-8114-3159c2104a4b {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:51:02.220951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6b353833f14c3d819164e23374591e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd29d875fc4d84f92801112d6d2accd13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:02.230615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-17f0f550-3d8c-4ee9-9457-cc3ab639549e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 200 len: 1309 microversion: 2.1 time: 0.116385 Aug 30 14:51:02.231102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 412/805] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:02 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:03.266969 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:03.267702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] [instance: a1dc1131-1052-471f-8114-3159c2104a4b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:03.275927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:03.276446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:03.276885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:03.277596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:03.278049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:03.278467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:03.296503 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] HTTP exception thrown: Instance a1dc1131-1052-471f-8114-3159c2104a4b could not be found. Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Request method failure captured: Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b HTTP/1.1 Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiL5tpbUlo7dSfUzxVuA2k7PwOalsMSuvTBwKZcbJTDCELbcjbhBBrl-PFxA51K2lfsh5qT7fPImmVxGOaKq9vwFqFxrXmZxxpFvE8MGFpVKJbqnvzITAe7pTSGSeqdHzUSTHdkKVwRLMHtx71VefuZwZuRWHpsNNM-pH5wzyQ73WdU Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: d29d875fc4d84f92801112d6d2accd13 Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesSnapshotTestJSON-642501947 Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:51:03.298465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d29d875fc4d84f92801112d6d2accd13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d29d875fc4d84f92801112d6d2accd13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d29d875fc4d84f92801112d6d2accd13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d29d875fc4d84f92801112d6d2accd13", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesSnapshotTestJSON-642501947 Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: d29d875fc4d84f92801112d6d2accd13 Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-642501947 Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesSnapshotTestJSON-642501947-project Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: bf6b353833f14c3d819164e23374591e Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesSnapshotTestJSON-642501947-project Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance a1dc1131-1052-471f-8114-3159c2104a4b could not be found. Aug 30 14:51:03.301136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'a1dc1131-1052-471f-8114-3159c2104a4b'} Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1dc1131-1052-471f-8114-3159c2104a4b could not be found. Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:51:03.302786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1dc1131-1052-471f-8114-3159c2104a4b could not be found. Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1dc1131-1052-471f-8114-3159c2104a4b could not be found. Aug 30 14:51:03.305775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:03.307445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] Returning 404 to user: Instance a1dc1131-1052-471f-8114-3159c2104a4b could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:51:03.307445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dfa60450-e912-430b-b263-56475661cd3e tempest-VolumesSnapshotTestJSON-642501947 tempest-VolumesSnapshotTestJSON-642501947-project] 10.222.0.25 "GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b" status: 404 len: 111 microversion: 2.1 time: 0.037923 Aug 30 14:51:03.307445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 394/806] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:03 2022] GET /compute/v2.1/servers/a1dc1131-1052-471f-8114-3159c2104a4b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:51:09.613132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:09.615739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:09.618295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:51:09.618511 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Tue Aug 30 14:51:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/action (ip 10.222.0.25) !!! Aug 30 14:51:09.631450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.631591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.631917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.632676 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.633134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.633685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.734862 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3fb8f3c3-edd0-440f-8311-d2d56d620945 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.125068 Aug 30 14:51:09.735636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 413/807] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:51:09 2022] POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:51:09.744502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:09.745287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:09.753799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.754285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.754708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.755417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.755856 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.756444 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.948343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:09.964075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c667506c-bad5-4790-bd4a-3ab4658a560e tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1751 microversion: 2.1 time: 0.223352 Aug 30 14:51:09.964910 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 395/808] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:09 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:10.031250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:10.031907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:10.042976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.043467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.043878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:10.044664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.045395 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.045873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:10.175158 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lazy-loading 'services' on Instance uuid c9e6f700-d63f-4672-80f4-1ff6f5d17c85 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:51:10.272238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fe7a84aa-9bc7-4edf-acc4-9ec331ac5789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-volume_attachments/55b113c9-579d-430c-a926-c1f03616a095" status: 202 len: 0 microversion: 2.1 time: 0.402790 Aug 30 14:51:10.272965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 414/809] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:51:09 2022] DELETE /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-volume_attachments/55b113c9-579d-430c-a926-c1f03616a095 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:51:10.987045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:10.987652 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:10.994987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.995479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.995936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:10.996666 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.997143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.997564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.177511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:11.193170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4f46fe62-9b9f-4096-bfba-9e59fa70dc37 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1751 microversion: 2.1 time: 0.209927 Aug 30 14:51:11.194599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 396/810] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:10 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:11.621908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:11.624405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:11.632322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.632939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.633489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.634317 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.634863 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.635445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.662025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'flavor' on Instance uuid d5552e35-b056-42a7-a699-e0f24a696704 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:51:11.858132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-938c6dd4-99fe-4ebc-828c-66dc9d31081f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/action" status: 200 len: 32 microversion: 2.1 time: 0.241716 Aug 30 14:51:11.858729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 415/811] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:51:11 2022] POST /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:51:11.868677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:11.869311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:11.877433 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.878254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.878948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.880316 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.881199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.882074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:12.201696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:12.218629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f1a0c1a5-2169-41dc-bf0a-ce90ff421b79 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.353455 Aug 30 14:51:12.219706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 397/812] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:11 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:12.235649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:12.236942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:12.246609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:12.247794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:12.249624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:12.251495 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:12.252760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:12.253616 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:12.634158 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:12.647376 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3a6699d8-62c7-416b-b372-03bdfa5ed060 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1751 microversion: 2.1 time: 0.417538 Aug 30 14:51:12.648500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 416/813] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:12 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1751 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:13.251199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:13.251810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:13.259013 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.259495 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.260307 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.261290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.261823 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.262445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.412297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:13.423175 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2a356256-af4f-4f39-a3e3-3d22a6fc5bdb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.175517 Aug 30 14:51:13.424044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 398/814] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:13 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:13.600384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-93848982-35bf-4241-991b-9fe722cd1596 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:13.606778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-93848982-35bf-4241-991b-9fe722cd1596 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.607273 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-93848982-35bf-4241-991b-9fe722cd1596 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.607702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-93848982-35bf-4241-991b-9fe722cd1596 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.635705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-93848982-35bf-4241-991b-9fe722cd1596 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Going to try to stop instance {{(pid=127176) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 14:51:13.673189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:13.673819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:13.682618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.683406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.683844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.684594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.685036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.685450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.687895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-93848982-35bf-4241-991b-9fe722cd1596 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action" status: 202 len: 0 microversion: 2.1 time: 0.091212 Aug 30 14:51:13.688541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 417/815] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:51:13 2022] POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:51:13.697637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:13.698472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:13.705071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.705555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.705980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.706709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.707149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.707536 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:14.164633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:14.167742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:14.171811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:14.173615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7c6eae98-ee9d-419d-af04-a0da18c27892 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.505481 Aug 30 14:51:14.174373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 399/816] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:13 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:14.176941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a5a9368b-c019-4891-9450-df8323989440 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.483497 Aug 30 14:51:14.177487 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 418/817] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:13 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:51:14.446888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:14.447745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:14.454088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:14.454565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:14.454994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:14.455759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:14.456298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:14.456790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:14.596935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:14.605497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8390fe87-3b80-4fc9-8be5-dcd09aebb74a tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.162585 Aug 30 14:51:14.606055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 400/818] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:14 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:15.197005 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:15.197693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:15.201080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:15.201848 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:15.205659 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.206145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.206576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.207280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.207729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.208195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.208493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.208985 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.209507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.210798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.211257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.211676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.418290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:15.424777 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:15.426624 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-679a50a1-ac65-4213-b2b1-29641ab57d28 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.229641 Aug 30 14:51:15.427208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 401/819] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:15 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:15.433911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-04f3e3aa-4cd4-4da6-8ffc-378534adf4bd tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.241442 Aug 30 14:51:15.434475 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 419/820] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:15 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:15.627026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:15.627720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:15.635610 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.636873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.637378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.638200 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.638640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.639053 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.794060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:15.803157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-906ae8bf-cd94-4a6e-b1b7-b06dac29ebb2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.180101 Aug 30 14:51:15.803716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 402/821] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:15 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:16.449431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:16.450002 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:16.455312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:16.455987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:16.456972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.457405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.457870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.458901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.459037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.459427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.462411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.462896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.464691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.464691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.464691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.465236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.652555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:16.660835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-bd35586a-f1b7-4877-aedf-168f7101c5eb tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.215482 Aug 30 14:51:16.661392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 420/822] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:16 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:16.683253 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:16.692364 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b5149583-06b8-4589-9ad2-46dfbd11ff72 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.240725 Aug 30 14:51:16.692971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 403/823] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:16 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:16.826303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:16.826816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:16.833489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.833971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.834400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.835082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.835514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.835924 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.985595 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:16.994106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6b44ae9b-70fb-4915-8adc-1720bca3730b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.172187 Aug 30 14:51:16.994664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 421/824] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:16 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:17.686410 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:17.687217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:17.695838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.696516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.697047 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.697998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.698592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.699067 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.714133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:17.714926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:17.721910 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.722399 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.722819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.723529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.723982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.724433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.901260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:17.909524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0b950bd9-4e5a-42dc-a73e-638c9492c574 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.229616 Aug 30 14:51:17.910111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 404/825] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:17 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:17.932670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:17.941889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-67d5ac75-ff97-471f-8263-18f569374eab tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.231763 Aug 30 14:51:17.942382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 422/826] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:17 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:51:18.015081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:18.015714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:18.022417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.022902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.023331 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.024045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.024505 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.024924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.176734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:18.181023 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:18.188693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ee618ce2-f709-4a25-8777-38ac210cc392 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.177271 Aug 30 14:51:18.189528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 405/827] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:18 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:18.935298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:18.935918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:18.945947 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.946548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.947130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.948151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.948792 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.949194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.964026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:18.966076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:18.972672 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.973165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.973590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.974277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.974718 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.975131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:19.159769 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:19.168292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-08b2a046-188f-481f-98ad-6eb00d295d6c tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.239140 Aug 30 14:51:19.169017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 423/828] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:18 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:19.177148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:19.187600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3ad88242-e948-42a5-8b37-788ce6a5cbc7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.228398 Aug 30 14:51:19.188544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 406/829] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:18 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:19.216280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:19.217101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:19.226649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:19.227336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:19.227957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:19.229042 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:19.229671 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:19.230205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:19.386010 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:19.394745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-af099469-3697-4a7e-9b06-7eb7500b616d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.184738 Aug 30 14:51:19.395425 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 424/830] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:19 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:20.190571 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:20.191182 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:20.198541 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.199130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.199658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.200449 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.201134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.201717 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.214132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:20.214795 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:20.221465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.221935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.222366 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.223051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.223507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.223925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.408029 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:20.416022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8365e5ad-f2fe-46f2-9d69-c5b63deddef9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.229315 Aug 30 14:51:20.416591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 407/831] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:20 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:20.421361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:20.421966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:20.425190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:20.430820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.431300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.431697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.432441 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.432883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.433353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.434752 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-47f80b2b-06e6-4813-b09d-1f8efa54fb3a tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.224569 Aug 30 14:51:20.435342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 425/832] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:20 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:20.579150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:20.587736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c3b33b0f-ebe1-4b48-bcad-b692324688f3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.170152 Aug 30 14:51:20.588336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 408/833] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:20 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:21.438670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:21.439300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:21.446217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.446698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.447156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.447824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.448279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.448800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.456372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:21.456956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:21.463661 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.464208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.464597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.465302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.465740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.466157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.646753 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:21.655182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4ef20d1d-f5e0-402c-8b5d-0b495951c548 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.220428 Aug 30 14:51:21.655762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 426/834] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:21 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:21.665939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:21.666523 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:21.673709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.673709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.673709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.674408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.674887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.675308 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.685104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:21.693760 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a08423c5-8131-474f-80e0-368eed44b560 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.241325 Aug 30 14:51:21.694455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 409/835] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:21 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:21.818179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:21.827261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8c9ae64e-4549-4c0a-aae4-c0095fd48a5e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.165080 Aug 30 14:51:21.827779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 427/836] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:21 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:22.677398 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:22.678016 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:22.685108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.685592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.686021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.686728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.687368 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.687790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.715432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:22.716067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:22.723404 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.724221 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.724873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.725787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.726432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.727080 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.878879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:22.887238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-376e4e0c-b796-4cf3-90ae-39d2325ae2a8 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.213763 Aug 30 14:51:22.887853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 410/837] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:22 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:22.892550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:22.893209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:22.900076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.900552 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.901189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.901883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.902335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.902753 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.921130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:22.930429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1a821c82-5bf3-4adb-8bec-51197b63e340 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.218528 Aug 30 14:51:22.931078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 428/838] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:22 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:51:23.035867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:23.044520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0eeb4f5c-7776-4bf9-b6ba-a51a4817ce5c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.155623 Aug 30 14:51:23.045091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 411/839] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:22 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:23.909670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:23.910262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:23.917291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.917778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.918209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:23.918899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.919349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.919771 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:23.952121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:23.952821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:23.960654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.961188 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.961632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:23.962335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.962786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.963209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:24.107342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:24.117236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-741b76ed-02d1-40d3-b444-104f50cd0ca7 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.211770 Aug 30 14:51:24.117809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 429/840] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:23 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:24.122318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:24.122933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:24.129605 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:24.130469 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:24.130597 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:24.131226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:24.131681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:24.132131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:24.148591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:24.157727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b1166958-453d-4984-b79e-5053e5d00149 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.209479 Aug 30 14:51:24.158296 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 412/841] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:23 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:24.268609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:24.279401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-625d5bae-7e72-49c6-ac33-eb9798193400 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.160593 Aug 30 14:51:24.280375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 430/842] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:24 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:25.139500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:25.140280 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:25.147202 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.147684 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.148141 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.148827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.149275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.149691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.179593 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:25.180644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:25.187681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.188207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.188638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.189339 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.189804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.190223 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.333773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:25.343148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d4d1af53-4f44-4fe1-a2c1-90e85bab256f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.207219 Aug 30 14:51:25.343991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 413/843] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:25 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:25.350724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:25.351333 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:25.357374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.357861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.358294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.358997 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.359448 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.360031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.379917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:25.389719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2cc41005-1224-4a82-9181-5ec4d09c1ef3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.214420 Aug 30 14:51:25.392819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 431/844] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:25 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:25.502290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:25.512243 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-68b7256e-8e21-4f25-86a1-d1432fe2576d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.167083 Aug 30 14:51:25.512835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 414/845] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:25 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:26.366687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:26.367303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:26.369643 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=51 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:26.375215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.375702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.376167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.376855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.377303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.377721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.414707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:26.415374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:26.422279 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.422759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.423183 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.423879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.424421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.424768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.574724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:26.582889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0996549a-04c1-4d49-9828-1e7381b12141 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.220486 Aug 30 14:51:26.583591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 432/846] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:26 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:26.589068 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:26.589669 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:26.595627 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.596323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.596766 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.597633 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.598080 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.598501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.616923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:26.625302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5e827a2a-d827-4c7d-8b7b-54017b1aba67 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.214817 Aug 30 14:51:26.626092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 415/847] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:26 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:26.739057 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:26.747810 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3cb45802-864b-4882-9856-a935321b8fab tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.163158 Aug 30 14:51:26.748614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 433/848] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:26 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:27.605197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:27.605798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:27.612402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.612886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.613322 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.614014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.614465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.614902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.647431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:27.648178 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:27.654618 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.655088 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.655501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.656229 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.656676 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.657090 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.828100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:27.836250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e78c10e1-8613-4c8d-94d3-289a3a7f1f40 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.234771 Aug 30 14:51:27.836806 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 416/849] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:27 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:27.841335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:27.841913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:27.847972 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.848910 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.849335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.850009 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.850451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.850863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.851185 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:27.860582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4400060a-df53-4119-826c-148c09ede443 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.216963 Aug 30 14:51:27.861181 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 434/850] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:27 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:27.988970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:27.997480 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-be5f3a58-a6e6-4ba3-ba8d-b2a704573d35 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.159703 Aug 30 14:51:27.998306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 417/851] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:27 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:28.858837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:28.859419 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:28.866364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.866850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.867285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:28.868037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.868493 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.868900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:28.882292 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:28.882856 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:28.885697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:28.887988 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:28.891519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.892026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.892449 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:28.893153 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.893602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.894021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:29.070282 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:29.078383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4132fa6a-c0cc-4c80-b138-79dbfe161e42 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1677 microversion: 2.1 time: 0.223553 Aug 30 14:51:29.078948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 435/852] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:28 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:29.083404 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:29.084031 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:29.089996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:29.095785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:29.096312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:29.096747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:29.097454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:29.097909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:29.098333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:29.098492 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f1ad1f77-fd8b-4e53-907c-c14619b68e7c tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1756 microversion: 2.1 time: 0.220131 Aug 30 14:51:29.099070 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 418/853] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:28 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:29.246772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:29.255865 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-835fbf1a-e6a8-47d5-9da6-1300efb32054 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.175901 Aug 30 14:51:29.256509 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 436/854] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:29 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:30.102794 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:30.103415 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:30.112778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.113443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.113963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.114979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.115522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.116022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.188205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:30.190801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:30.198147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.198808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.199214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.199921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.200405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.200825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.305586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:30.315405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aff42146-fbcf-46bd-8b36-6a024d6e00e5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1654 microversion: 2.1 time: 0.218321 Aug 30 14:51:30.316381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 419/855] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:30 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1654 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:30.323580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:30.328082 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:30.337241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.337825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.338377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.339311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.339846 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.341060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.401615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:30.410943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4c834a93-e30c-4382-ba7e-eea968748313 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1759 microversion: 2.1 time: 0.233188 Aug 30 14:51:30.412042 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 437/856] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:30 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:30.417221 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-388325ba-fb69-46c7-a4c5-27674458bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:30.423837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-388325ba-fb69-46c7-a4c5-27674458bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.424688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-388325ba-fb69-46c7-a4c5-27674458bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.425342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-388325ba-fb69-46c7-a4c5-27674458bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.451409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-388325ba-fb69-46c7-a4c5-27674458bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Going to try to start instance {{(pid=127176) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 14:51:30.499416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-388325ba-fb69-46c7-a4c5-27674458bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action" status: 202 len: 0 microversion: 2.1 time: 0.085753 Aug 30 14:51:30.500153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 438/857] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:51:30 2022] POST /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:51:30.504726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:30.508925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:30.509955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:30.516043 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d7ba7e17-487e-48ec-a36c-1da3b5e7608b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.198252 Aug 30 14:51:30.516704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.517191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.517548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 420/858] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:30 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:30.517668 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.520936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.521579 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.522282 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.675346 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:30.684344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-884edf68-ea3a-4166-8943-df56d291dbad tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1663 microversion: 2.1 time: 0.179534 Aug 30 14:51:30.685112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 439/859] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:30 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:51:31.539064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:31.539709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:31.548746 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.549256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.549773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.550867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.551524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.552344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.706897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:31.707672 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:31.715170 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.715642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.716108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.716807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.717252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.717649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.842372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:31.851913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6055d05d-8412-48f2-bb30-e4ab7e416c69 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.316639 Aug 30 14:51:31.852640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 421/860] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:31 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:31.892024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:31.900698 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9a7567fb-c338-4b78-a4b1-f51ca2d2d78b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1663 microversion: 2.1 time: 0.197875 Aug 30 14:51:31.901258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 440/861] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:31 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:32.873618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:32.874209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:32.883055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.883823 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.884467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:32.885643 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.886297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.886893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:32.905119 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:32.922253 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:32.922914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:32.930885 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.931498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.932027 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:32.932813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.933341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.933856 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:33.065158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:33.075422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-489cce92-1e65-4b75-ba7c-7a73c6310e1b tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.205603 Aug 30 14:51:33.076020 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 422/862] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:32 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:33.105719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:33.114709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cb290d15-893b-41ed-8b00-95236b111a73 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1667 microversion: 2.1 time: 0.196353 Aug 30 14:51:33.115278 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 441/863] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:32 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1667 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:34.099907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:34.100966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:34.114867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:34.115601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:34.116249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:34.117425 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:34.118097 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:34.118737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:34.258825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:34.272215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-34bc465f-1fdc-46db-9a09-2cb6d25529e1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.178161 Aug 30 14:51:34.273061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 423/864] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:34 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:35.300678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:35.301346 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:35.309781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:35.310270 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:35.310705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:35.311408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:35.311861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:35.312306 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:35.708442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:35.719736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a7f6cb4d-4a7b-4299-beb1-d086beb046da tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.423059 Aug 30 14:51:35.720353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 442/865] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:35 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:36.742493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:36.743130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:36.750762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:36.751262 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:36.751732 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:36.752565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:36.753059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:36.753498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:36.899740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:36.909314 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9061586a-d2c0-45da-8129-b91529b0c8b5 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1736 microversion: 2.1 time: 0.171137 Aug 30 14:51:36.909889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 424/866] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:36 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:37.932112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:37.932728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:37.939788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:37.940312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:37.940748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:37.941451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:37.941899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:37.942315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.088172 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:38.097212 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-89626a34-922b-46be-8255-6b8d26aad29c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1716 microversion: 2.1 time: 0.169662 Aug 30 14:51:38.097892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 443/867] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:37 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:38.221697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:38.222353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:38.229300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.229788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.230207 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.230929 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.231375 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.231801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.376516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] HTTP exception thrown: Cannot 'detach_volume' instance d5552e35-b056-42a7-a699-e0f24a696704 while it is in vm_state rescued Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Request method failure captured: Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments/42adbeb6-046f-4b08-8321-f3a6ea551af4 HTTP/1.1 Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJBt6DT6XPRSNgF4YQ20t2R5-A5QLe3R2nH0anCT7IqtSIz8tQpjuk4LmnHpdtyEsEO_qdxPf3NilU02EEdCojhWvVjaiNKiSaH6KqZIoN8b7AVnzUpmd46eyKonkhoItSCg-K3q20XuBM9AvACsqBJAcs13ti2fMwQYZYuvl7I5bM Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:51:38.378019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52028232fa7e4d808057e3e5512e6135", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 3398704b0dbc4af08e94b774a88851a4 Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:51:38.379522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Cannot 'detach_volume' instance d5552e35-b056-42a7-a699-e0f24a696704 while it is in vm_state rescued Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'server_id': 'd5552e35-b056-42a7-a699-e0f24a696704', 'id': '42adbeb6-046f-4b08-8321-f3a6ea551af4'} Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d5552e35-b056-42a7-a699-e0f24a696704 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:51:38.380387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d5552e35-b056-42a7-a699-e0f24a696704 while it is in vm_state rescued Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d5552e35-b056-42a7-a699-e0f24a696704 while it is in vm_state rescued Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:51:38.381996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Returning 409 to user: Cannot 'detach_volume' instance d5552e35-b056-42a7-a699-e0f24a696704 while it is in vm_state rescued {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:51:38.383007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b2d84cfd-aee3-4d7b-a129-09c4a8562e97 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments/42adbeb6-046f-4b08-8321-f3a6ea551af4" status: 409 len: 152 microversion: 2.1 time: 0.163531 Aug 30 14:51:38.383007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 425/868] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:51:38 2022] DELETE /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments/42adbeb6-046f-4b08-8321-f3a6ea551af4 => generated 152 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 14:51:38.388958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:38.389486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:38.397460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.398029 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.398454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.399143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.399582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.400005 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.470584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-28329614-ad7c-49eb-91f2-e210e1d3678e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "POST /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/action" status: 202 len: 0 microversion: 2.1 time: 0.085398 Aug 30 14:51:38.471218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 444/869] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:51:38 2022] POST /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:51:38.479651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:38.480393 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:38.487607 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.488296 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.488578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.489443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.499854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.499854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.700892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:38.710302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3db5a108-e49e-450f-949c-669aecf8f0d2 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1724 microversion: 2.1 time: 0.234493 Aug 30 14:51:38.710792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 426/870] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:38 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:39.734028 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:39.734864 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:39.741673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:39.742158 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:39.742591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:39.743281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:39.743733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:39.744180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:39.894254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:39.907051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-63810228-451a-4eed-96c3-3c9d54f7280d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1724 microversion: 2.1 time: 0.177731 Aug 30 14:51:39.907622 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 445/871] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:39 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:40.932132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:40.932899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:40.942768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:40.943435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:40.944066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:40.945016 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:40.945607 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:40.946178 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:41.080779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:41.089579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1edf5463-244b-43fd-b58c-9ecee10d9658 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1724 microversion: 2.1 time: 0.164399 Aug 30 14:51:41.090113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 427/872] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:40 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:42.114166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:42.114793 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:42.124372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:42.125039 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:42.125552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:42.126571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:42.127109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:42.127886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:42.271812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:42.280589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f1d37b3d-61b9-42c8-a884-e595daebe16e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1724 microversion: 2.1 time: 0.172549 Aug 30 14:51:42.281163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 446/873] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:42 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:43.301536 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:43.302159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:43.309523 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.310006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.310427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.311121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.311572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.311987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.452372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:51:43.461585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-41580d7a-3c63-4648-b0fe-2cfdec527b01 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1730 microversion: 2.1 time: 0.164026 Aug 30 14:51:43.462151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 428/874] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:51:43 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:51:43.482823 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:43.483408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:43.490464 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.490950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.491381 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.492118 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.492571 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.492968 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.578338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e8db0ffb-c871-4623-93cf-b5d7b911a7cc tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099362 Aug 30 14:51:43.578991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 447/875] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:51:43 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:44.545122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-8a539a69-b2a2-4155-bbc7-4d4a56a3e955 req-0d671216-505d-4db3-b6c8-ddf32124ac7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5552e35-b056-42a7-a699-e0f24a696704", "tag": "c2a653f7-0c72-4f59-add6-44e44654186f"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:44.557702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-8a539a69-b2a2-4155-bbc7-4d4a56a3e955 req-0d671216-505d-4db3-b6c8-ddf32124ac7b service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:44.558168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-8a539a69-b2a2-4155-bbc7-4d4a56a3e955 req-0d671216-505d-4db3-b6c8-ddf32124ac7b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:44.558806 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-8a539a69-b2a2-4155-bbc7-4d4a56a3e955 req-0d671216-505d-4db3-b6c8-ddf32124ac7b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:44.578122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-8a539a69-b2a2-4155-bbc7-4d4a56a3e955 req-0d671216-505d-4db3-b6c8-ddf32124ac7b service nova] Creating event network-changed:c2a653f7-0c72-4f59-add6-44e44654186f for instance d5552e35-b056-42a7-a699-e0f24a696704 on hv-cinder-82880 Aug 30 14:51:44.583104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-8a539a69-b2a2-4155-bbc7-4d4a56a3e955 req-0d671216-505d-4db3-b6c8-ddf32124ac7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041633 Aug 30 14:51:44.584132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 429/876] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:46.609016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-0f1e7796-2a58-4339-b698-adbed3a77bc8 req-b0561b9e-fe73-483f-b8ab-437d4e9a4642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5552e35-b056-42a7-a699-e0f24a696704", "tag": "c2a653f7-0c72-4f59-add6-44e44654186f"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:51:46.620217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-0f1e7796-2a58-4339-b698-adbed3a77bc8 req-b0561b9e-fe73-483f-b8ab-437d4e9a4642 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:46.620703 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-0f1e7796-2a58-4339-b698-adbed3a77bc8 req-b0561b9e-fe73-483f-b8ab-437d4e9a4642 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:46.621136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-0f1e7796-2a58-4339-b698-adbed3a77bc8 req-b0561b9e-fe73-483f-b8ab-437d4e9a4642 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:46.637937 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-0f1e7796-2a58-4339-b698-adbed3a77bc8 req-b0561b9e-fe73-483f-b8ab-437d4e9a4642 service nova] Creating event network-changed:c2a653f7-0c72-4f59-add6-44e44654186f for instance d5552e35-b056-42a7-a699-e0f24a696704 on hv-cinder-82880 Aug 30 14:51:46.643690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-0f1e7796-2a58-4339-b698-adbed3a77bc8 req-b0561b9e-fe73-483f-b8ab-437d4e9a4642 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044236 Aug 30 14:51:46.644503 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 448/877] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:59.660479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=23 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:59.662007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=40 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:59.667263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:59.667853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:59.675067 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.675547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.675974 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.677360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.677815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.678235 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.711647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ddcf29dd-5096-4820-9272-2faa686b2738 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments/63fcfdcc-f07c-4e3a-8a84-f5665b34c047" status: 200 len: 194 microversion: 2.20 time: 0.052893 Aug 30 14:51:59.712264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 430/878] 10.222.0.25 () {60 vars in 1454 bytes} [Tue Aug 30 14:51:59 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments/63fcfdcc-f07c-4e3a-8a84-f5665b34c047 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:59.780507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=33 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:59.781257 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:59.785602 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:59.786193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:59.793555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.794028 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.794462 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.795142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.795581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.795991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.889061 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lazy-loading 'services' on Instance uuid 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:51:59.975597 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ba24431c-4e79-4014-bc10-19d3cf972744 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments/63fcfdcc-f07c-4e3a-8a84-f5665b34c047" status: 202 len: 0 microversion: 2.20 time: 0.196476 Aug 30 14:51:59.976239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 449/879] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Aug 30 14:51:59 2022] DELETE /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments/63fcfdcc-f07c-4e3a-8a84-f5665b34c047 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:51:59.986018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:59.988841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:59.995209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.995878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.996395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.997141 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.997679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.998257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:00.030758 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-89c62812-f24e-415c-a98e-d016b6708d1f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049855 Aug 30 14:52:00.031366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 431/880] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:59 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:52:01.045386 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:01.048057 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:01.055920 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:01.056442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:01.056873 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:01.057592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:01.058038 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:01.058459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:01.093458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1ef01ad9-9883-4597-a28e-1485e0897a16 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053532 Aug 30 14:52:01.094056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 450/881] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:01 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:02.106448 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:02.108637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:02.115720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.116241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.116660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.117344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.117789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.118200 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.149057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-55971e29-3b30-4f1f-8ee5-58f21397c514 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046605 Aug 30 14:52:02.149631 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 432/882] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:02 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:02.219806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:02.220430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:02.228503 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.228994 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.229432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.230129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.230586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.231254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.260325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:52:02.357786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ce3f81fc-f14f-40bc-b7ef-ac6bb8b7038f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 204 len: 0 microversion: 2.20 time: 0.141285 Aug 30 14:52:02.358472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 451/883] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 14:52:02 2022] DELETE /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 14:52:02.369360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:02.369965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:02.376110 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.376594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.376999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.377689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.378131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.378554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.519620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:02.528618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:02.530040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:02.531248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e3f4b00d-f833-43c6-93d8-dd4ed77ab17f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.166121 Aug 30 14:52:02.531764 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 433/884] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:02 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:03.559778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:03.560669 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:03.570445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:03.570925 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:03.571351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:03.572040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:03.572512 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:03.572899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:03.712454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:03.721318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:03.722759 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:03.723940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1cb6b9e4-aa78-43ea-b49b-27085994acff tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.171288 Aug 30 14:52:03.724508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 452/885] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:03 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:04.753487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:04.754187 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:04.760961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:04.761443 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:04.761869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:04.762561 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:04.763007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:04.763424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:04.984036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:04.993656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:04.995324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:04.996537 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-55ed344e-eae3-4e7e-b1c4-f2117359066a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1722 microversion: 2.20 time: 0.247056 Aug 30 14:52:04.997259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 434/886] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:04 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:52:05.974450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-637b935b-838a-49e5-9421-ea533ad41a19 req-2391373c-e53a-4fb5-ba6b-327c30d938a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1622c2-5c2a-4656-b39c-0f2f520fcf52", "name": "network-vif-deleted", "tag": "cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:05.991819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-637b935b-838a-49e5-9421-ea533ad41a19 req-2391373c-e53a-4fb5-ba6b-327c30d938a5 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:05.992700 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-637b935b-838a-49e5-9421-ea533ad41a19 req-2391373c-e53a-4fb5-ba6b-327c30d938a5 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:05.994958 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-637b935b-838a-49e5-9421-ea533ad41a19 req-2391373c-e53a-4fb5-ba6b-327c30d938a5 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:06.011844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-637b935b-838a-49e5-9421-ea533ad41a19 req-2391373c-e53a-4fb5-ba6b-327c30d938a5 service nova] Creating event network-vif-deleted:cc9d32a6-c9f2-4275-a1a8-7c466beeb7d1 for instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 on hv-cinder-82880 Aug 30 14:52:06.020719 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:06.021671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:06.026470 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-637b935b-838a-49e5-9421-ea533ad41a19 req-2391373c-e53a-4fb5-ba6b-327c30d938a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058812 Aug 30 14:52:06.027077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 453/887] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:06.033238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:06.035125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:06.035905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:06.037435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:06.038831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:06.040058 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:06.131029 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:06.143880 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:06.146148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:06.147934 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-57440a91-53c2-4554-8793-89e7cba83307 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 200 len: 1366 microversion: 2.20 time: 0.131350 Aug 30 14:52:06.156511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 435/888] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:06 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:07.173862 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:07.174547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:07.181712 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:07.182197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:07.182627 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:07.184573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:07.184573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:07.184573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:07.199310 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] HTTP exception thrown: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Request method failure captured: Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 HTTP/1.1 Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiI-PxYP8QyaTIsRZGl8lYFVmVxS9kVkdh8QKkJRBXrmhdy7ZlMsHIIE4lWMJe99jpr19YL3cuNjicjOs3SQ43Sdrkh0wZIRKK0GM2dWDc6R9hrJFV1RvHOvuAg_K6crZylQrvdbn3UyT79U9FrwYpzW-qovgdXkJnsB_EUgv3PRWU4 Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:52:07.201051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21f6e5be24e448f9b981ad77d23de8bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 521cc5ea8fb045bc81e8e3bfa8ba239b Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:52:07.202788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '8c1622c2-5c2a-4656-b39c-0f2f520fcf52'} Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:07.204166 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:52:07.205729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:07.207796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Returning 404 to user: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:07.207796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f8830553-fca7-4f76-9cff-31315fc365c0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 404 len: 111 microversion: 2.20 time: 0.034923 Aug 30 14:52:07.207796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 454/889] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:07 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:52:07.212551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95aff29f-9704-4dc5-a4c6-a84f445a6ef5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '.version_select at 0x7fe6a63d0c10>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:07.238872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-95aff29f-9704-4dc5-a4c6-a84f445a6ef5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836101936" status: 204 len: 0 microversion: 2.20 time: 0.030585 Aug 30 14:52:07.239471 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 436/890] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 14:52:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836101936 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 14:52:07.869673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6bb029b2-f983-4bdb-b596-272751cc6cb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'create', calling method: .version_select at 0x7fe6a62e3b80>, body: {"keypair": {"name": "tempest-keypair-1610858743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9tiYiyUCo5iKgqvFo/zqk15ThE49lIZb+h+tFH1lUzMODVfZjES0DPlQz9izitwkwgYlAX5echpDXwA9x/QefuygT82nHZlFpTG7YQ9lfKbdwlmzLZ58LSUsSNGJpN7Q=="}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:07.887461 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-6bb029b2-f983-4bdb-b596-272751cc6cb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:52:07.892173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-6bb029b2-f983-4bdb-b596-272751cc6cb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for user 521cc5ea8fb045bc81e8e3bfa8ba239b and project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:52:07.922277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6bb029b2-f983-4bdb-b596-272751cc6cb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056791 Aug 30 14:52:07.923182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 455/891] 10.222.0.25 () {62 vars in 1200 bytes} [Tue Aug 30 14:52:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 14:52:09.355486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1038560800", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aeb2ec1e-a5f8-4f44-849b-b5b5a0519a69"}], "security_groups": [{"name": "tempest-securitygroup--658468697"}], "key_name": "tempest-keypair-1610858743", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:09.487436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] validate_networks() for [('aeb2ec1e-a5f8-4f44-849b-b5b5a0519a69', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:52:09.954827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:52:09.955236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:52:09.955695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:52:09.956245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:52:09.956648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:52:09.971131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:09.971805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:09.972301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:09.973012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:09.973580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:09.974180 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:09.999509 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:52:10.004047 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Getting quotas for user 521cc5ea8fb045bc81e8e3bfa8ba239b and project 21f6e5be24e448f9b981ad77d23de8bd. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:52:10.017287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:52:10.019639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:52:10.090469 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-22336888-73c0-44b7-b031-3a3547dc0b37 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.740528 Aug 30 14:52:10.091285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 437/892] 10.222.0.25 () {62 vars in 1188 bytes} [Tue Aug 30 14:52:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 14:52:10.111871 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f9a13a4c-3718-46ad-82ed-f4b228e7a44c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:10.112638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f9a13a4c-3718-46ad-82ed-f4b228e7a44c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:10.177543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f9a13a4c-3718-46ad-82ed-f4b228e7a44c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:10.187318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f9a13a4c-3718-46ad-82ed-f4b228e7a44c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:10.189352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f9a13a4c-3718-46ad-82ed-f4b228e7a44c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:10.190486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f9a13a4c-3718-46ad-82ed-f4b228e7a44c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1282 microversion: 2.20 time: 0.089301 Aug 30 14:52:10.191020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 456/893] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:10 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:11.214056 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:11.214625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:11.221330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:11.221814 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:11.222474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:11.223249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:11.223748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:11.224320 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:11.296132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:11.307577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:11.309035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:11.310137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c2af2684-ed94-4355-b556-84222946d1f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1334 microversion: 2.20 time: 0.100814 Aug 30 14:52:11.310675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 438/894] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:11 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:12.332960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:12.333731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:12.341153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:12.341634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:12.342129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:12.342828 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:12.343268 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:12.343867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:12.485731 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:12.494541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:12.495965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:12.497106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-aa3b7c77-06b4-4c40-889c-62e287fb1703 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.168135 Aug 30 14:52:12.497665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 457/895] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:12 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:13.110996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-595b890e-3319-413a-9a37-964c80cb935b req-0673a68a-188e-4bb2-94d5-a4aed8072ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e97534-d604-4593-8ebd-af7e01f58d5a", "tag": "c0b078a2-1c95-4a1f-a09a-bc30f5710e7c"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:13.121891 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-595b890e-3319-413a-9a37-964c80cb935b req-0673a68a-188e-4bb2-94d5-a4aed8072ed3 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:13.122376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-595b890e-3319-413a-9a37-964c80cb935b req-0673a68a-188e-4bb2-94d5-a4aed8072ed3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:13.122787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-595b890e-3319-413a-9a37-964c80cb935b req-0673a68a-188e-4bb2-94d5-a4aed8072ed3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:13.134618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-595b890e-3319-413a-9a37-964c80cb935b req-0673a68a-188e-4bb2-94d5-a4aed8072ed3 service nova] Creating event network-changed:c0b078a2-1c95-4a1f-a09a-bc30f5710e7c for instance 96e97534-d604-4593-8ebd-af7e01f58d5a on hv-cinder-82880 Aug 30 14:52:13.139698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-595b890e-3319-413a-9a37-964c80cb935b req-0673a68a-188e-4bb2-94d5-a4aed8072ed3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032346 Aug 30 14:52:13.140328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 439/896] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:13.525716 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:13.526815 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:13.534891 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:13.535349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:13.535796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:13.536530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:13.536976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:13.537422 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:13.752662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:13.762541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:13.764069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:13.765439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-aea6736a-5ad2-46f6-a044-ab75deceddc4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.247504 Aug 30 14:52:13.765971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 458/897] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:13 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:14.793159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:14.793850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:14.801208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:14.801739 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:14.802211 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:14.803012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:14.803508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:14.803966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:14.952790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:14.963793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:14.965671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:14.966793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b7d7e0df-f53e-4554-a355-d62888cd4586 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.178919 Aug 30 14:52:14.967348 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 440/898] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:14 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:16.000318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:16.001187 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:16.010191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.010711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.011297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:16.012322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.012969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.013636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:16.161514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:16.170614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:16.172040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:16.173171 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9bfea3d1-e816-464d-88d9-3d388c4939f9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.179387 Aug 30 14:52:16.173724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 459/899] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:15 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:17.199018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:17.199629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:17.209305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.209859 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.210309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.210998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.211439 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.211848 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.355949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:17.364363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:17.365775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:17.366864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cbd056fc-1661-4864-af14-9da95b57cc56 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.174529 Aug 30 14:52:17.367420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 441/900] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:17 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:17.485154 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:17.486357 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:17.491865 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.492362 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.492785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.493455 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.493894 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.494327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.518930 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-07e4e948-d9df-4be3-9315-e3ee6935cc9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382/ips" status: 200 len: 150 microversion: 2.1 time: 0.308116 Aug 30 14:52:17.519505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 460/901] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:52:17 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382/ips => generated 150 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:17.531196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e67966e4-d138-41f2-88e1-4672ca54e786"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:17.533749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:17.539659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.540165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.540588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.541270 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.541727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.542117 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.626795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Invalid volume: volume e67966e4-d138-41f2-88e1-4672ca54e786 is already attached to instances: 6bec4834-0075-439c-bca0-5c5abf786d13 Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382/os-volume_attachments HTTP/1.1 Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 74 Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:52:17.628587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {"volumeAttachment": {"volumeId": "e67966e4-d138-41f2-88e1-4672ca54e786"}} Aug 30 14:52:17.631249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Invalid volume: volume e67966e4-d138-41f2-88e1-4672ca54e786 is already attached to instances: 6bec4834-0075-439c-bca0-5c5abf786d13 Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'server_id': 'f0a8e249-ce8d-48bd-af4e-ae32d0eed382', 'body': {'volumeAttachment': {'volumeId': 'e67966e4-d138-41f2-88e1-4672ca54e786'}}} Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e67966e4-d138-41f2-88e1-4672ca54e786 is already attached to instances: 6bec4834-0075-439c-bca0-5c5abf786d13 Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:17.635983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e67966e4-d138-41f2-88e1-4672ca54e786 is already attached to instances: 6bec4834-0075-439c-bca0-5c5abf786d13 Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:17.637849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e67966e4-d138-41f2-88e1-4672ca54e786 is already attached to instances: 6bec4834-0075-439c-bca0-5c5abf786d13 Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 400 to user: Invalid volume: volume e67966e4-d138-41f2-88e1-4672ca54e786 is already attached to instances: 6bec4834-0075-439c-bca0-5c5abf786d13 {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-25a70bfd-5467-4430-b49b-f86102e7cf27 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102856 Aug 30 14:52:17.640284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 442/902] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:52:17 2022] POST /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:52:17.640950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:17.641445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:17.650686 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.651590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.652176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.652916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.653446 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.654074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.680810 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:52:17.767611 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c250057e-126a-4c32-9a7f-f415df307fe2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 204 len: 0 microversion: 2.1 time: 0.131875 Aug 30 14:52:17.768461 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 461/903] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:52:17 2022] DELETE /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:52:17.776454 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:17.777060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:17.784290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.784802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.785231 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.785925 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.786402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.786785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.918633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:17.926911 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-78df4801-a0e1-42a1-a651-cce47b47d670 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1680 microversion: 2.1 time: 0.154299 Aug 30 14:52:17.927473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 443/904] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:17 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:18.390757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:18.391480 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:18.398801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.399315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.399724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:18.400554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.401180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.401897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:18.552944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:18.562220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:18.563709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:18.564851 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f40e3c60-d812-4baa-89ed-67f6bbeae0e7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.178440 Aug 30 14:52:18.565413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 462/905] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:18 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:18.950134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:18.950744 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:18.958691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.959164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.959600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:18.960326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.960780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.961199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:19.100681 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:19.108987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-318ccb57-3da8-4b03-9b0c-0dd5da2f1944 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1680 microversion: 2.1 time: 0.162979 Aug 30 14:52:19.109562 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 444/906] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:18 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:19.587143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:19.587811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:19.594831 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:19.595323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:19.595904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:19.596725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:19.597269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:19.597748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:19.732195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:19.740840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:19.742315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:19.743645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f4c65bbb-993b-4cb8-abcf-1ef84b1e6df3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.160362 Aug 30 14:52:19.743991 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 463/907] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:19 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:20.132854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:20.133516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:20.136519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:20.137131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:20.144229 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.144871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.145413 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:20.146378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.147012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.147510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:20.618084 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:20.626715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e3b0b0bc-d758-4c42-a511-17019dec166a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1680 microversion: 2.1 time: 0.499032 Aug 30 14:52:20.627458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 445/908] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:20 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1680 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:20.767906 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:20.768564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:20.771370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:20.779272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.779948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.780428 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:20.781276 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.781960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.782529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.006847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:21.015388 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:21.017078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:21.018202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c3845938-2671-4f78-bb24-1dee7deaad4c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.254949 Aug 30 14:52:21.018758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 464/909] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:20 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:21.462429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-6572f2bb-6b49-4dc4-98ad-9c8604006e0a req-231715f3-160a-496b-92fe-849a88940fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a8e249-ce8d-48bd-af4e-ae32d0eed382", "name": "network-vif-deleted", "tag": "c3907648-f43c-43ba-9e60-96fe2de992af"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:21.474097 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-6572f2bb-6b49-4dc4-98ad-9c8604006e0a req-231715f3-160a-496b-92fe-849a88940fb2 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.474564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-6572f2bb-6b49-4dc4-98ad-9c8604006e0a req-231715f3-160a-496b-92fe-849a88940fb2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.474981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-6572f2bb-6b49-4dc4-98ad-9c8604006e0a req-231715f3-160a-496b-92fe-849a88940fb2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.487774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-6572f2bb-6b49-4dc4-98ad-9c8604006e0a req-231715f3-160a-496b-92fe-849a88940fb2 service nova] Creating event network-vif-deleted:c3907648-f43c-43ba-9e60-96fe2de992af for instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 on hv-cinder-82880 Aug 30 14:52:21.493301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-6572f2bb-6b49-4dc4-98ad-9c8604006e0a req-231715f3-160a-496b-92fe-849a88940fb2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034483 Aug 30 14:52:21.497572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 446/910] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:21.650165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:21.651096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:21.658186 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.658826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.659354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.660200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.660878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.661526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.666383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:21.709984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.710874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.711507 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.712329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'fault' on Instance uuid f0a8e249-ce8d-48bd-af4e-ae32d0eed382 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:21.777977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:21.787041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-51c1d0a9-f04d-459f-b49c-926378de446b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1330 microversion: 2.1 time: 0.142371 Aug 30 14:52:21.804844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 465/911] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:21 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1330 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:21.807625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-15f71de5-584b-49e4-bf7f-399ecfad0ab4 req-76308db4-cefc-4853-abb5-0c0866fee029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e97534-d604-4593-8ebd-af7e01f58d5a", "name": "network-vif-plugged", "status": "completed", "tag": "c0b078a2-1c95-4a1f-a09a-bc30f5710e7c"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:21.821831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-15f71de5-584b-49e4-bf7f-399ecfad0ab4 req-76308db4-cefc-4853-abb5-0c0866fee029 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.822596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-15f71de5-584b-49e4-bf7f-399ecfad0ab4 req-76308db4-cefc-4853-abb5-0c0866fee029 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.823578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-15f71de5-584b-49e4-bf7f-399ecfad0ab4 req-76308db4-cefc-4853-abb5-0c0866fee029 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.836862 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-15f71de5-584b-49e4-bf7f-399ecfad0ab4 req-76308db4-cefc-4853-abb5-0c0866fee029 service nova] Creating event network-vif-plugged:c0b078a2-1c95-4a1f-a09a-bc30f5710e7c for instance 96e97534-d604-4593-8ebd-af7e01f58d5a on hv-cinder-82880 Aug 30 14:52:21.844022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-15f71de5-584b-49e4-bf7f-399ecfad0ab4 req-76308db4-cefc-4853-abb5-0c0866fee029 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046402 Aug 30 14:52:21.844987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 447/912] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:22.041349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:22.041933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:22.048592 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.049070 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.049520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.050241 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.050680 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.051091 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.247552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:22.256337 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:22.257790 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:22.258897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-672777d2-994e-4a50-8ab2-b7374a268b8b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.222372 Aug 30 14:52:22.259430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 466/913] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:22 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:22.815565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:22.816678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:22.824752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.825332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.825873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.827054 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.827615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.828301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.865777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.866247 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.866677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.867123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'fault' on Instance uuid f0a8e249-ce8d-48bd-af4e-ae32d0eed382 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:22.910885 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:22.918946 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-de1027b7-8bd3-409d-87f3-ccf7957f8cc5 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1330 microversion: 2.1 time: 0.110721 Aug 30 14:52:22.919545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 448/914] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:22 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:23.282135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:23.282708 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:23.290266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.290841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.291272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.292016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.292466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.292886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.451071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:23.467786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:23.470850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:23.473098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3c1b3bc1-b3be-42dd-84ee-2deb06f46028 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1407 microversion: 2.20 time: 0.194956 Aug 30 14:52:23.474130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 467/915] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:23 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:23.941562 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:23.942121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:23.948970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.949447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.949892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.950598 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.951049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.951708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.986338 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.986824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.987250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.987696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'fault' on Instance uuid f0a8e249-ce8d-48bd-af4e-ae32d0eed382 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:23.990907 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:24.030433 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:24.038533 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1ac40f5c-3a66-467e-84eb-0ffd9146ae39 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 200 len: 1330 microversion: 2.1 time: 0.101058 Aug 30 14:52:24.039112 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 449/916] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:23 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:24.511745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:24.512377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:24.520144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.520602 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.521059 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.521757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.522201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.522620 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.661299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:24.671932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:24.673555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:24.675489 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3041b02b-4887-4f46-b027-48303d0f0859 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1598 microversion: 2.20 time: 0.167692 Aug 30 14:52:24.676050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 468/917] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:52:24 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:52:24.699556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:24.700048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:24.708215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.709665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.710096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.710918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.711441 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.711866 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.801830 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-87036dc3-e1ed-4b4c-b4a6-e1e83363e8f1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106725 Aug 30 14:52:24.802471 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 450/918] 10.222.0.25 () {60 vars in 1316 bytes} [Tue Aug 30 14:52:24 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:25.060574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:25.061230 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:25.068605 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.069114 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.069550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:25.070269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.070759 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.071169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:25.087224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 HTTP/1.1 Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:52:25.088949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:52:25.090526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': 'f0a8e249-ce8d-48bd-af4e-ae32d0eed382'} Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:25.091474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:52:25.093182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:25.095177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:25.095177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-208b7ae5-fc44-4d5a-922c-d385129bdc4a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 404 len: 111 microversion: 2.1 time: 0.034582 Aug 30 14:52:25.095177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 469/919] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:25 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:52:25.101821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-46aeab80-fb0c-4eb6-b15c-01a77f26fa01 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '.version_select at 0x7fe6a63f9790>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:25.126790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-46aeab80-fb0c-4eb6-b15c-01a77f26fa01 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835778948" status: 202 len: 0 microversion: 2.1 time: 0.029421 Aug 30 14:52:25.131228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 451/920] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 14:52:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835778948 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:25.896629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:25.897433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:25.905228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.905717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.906153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:25.906893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.907922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.908380 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.001311 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'services' on Instance uuid 6bec4834-0075-439c-bca0-5c5abf786d13 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:26.084410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-97827e80-c367-4c3d-b780-9d13c94dbc3a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments/e67966e4-d138-41f2-88e1-4672ca54e786" status: 202 len: 0 microversion: 2.1 time: 0.194143 Aug 30 14:52:26.085495 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 470/921] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:52:25 2022] DELETE /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments/e67966e4-d138-41f2-88e1-4672ca54e786 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:26.095588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:26.097994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:26.106726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:26.108132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:26.108794 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.109725 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:26.110236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:26.110661 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.148466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7241460b-585c-42b7-9dc3-5ad52d2d08bc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058474 Aug 30 14:52:26.149221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 452/922] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:26 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:26.165255 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-37a3e886-8cf1-4164-b6ec-83233405b633 req-08c15999-9ffb-48f4-97ef-74d542a75ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e97534-d604-4593-8ebd-af7e01f58d5a", "tag": "c0b078a2-1c95-4a1f-a09a-bc30f5710e7c"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:26.175811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-37a3e886-8cf1-4164-b6ec-83233405b633 req-08c15999-9ffb-48f4-97ef-74d542a75ad8 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:26.176351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-37a3e886-8cf1-4164-b6ec-83233405b633 req-08c15999-9ffb-48f4-97ef-74d542a75ad8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:26.176782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-37a3e886-8cf1-4164-b6ec-83233405b633 req-08c15999-9ffb-48f4-97ef-74d542a75ad8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.189232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-37a3e886-8cf1-4164-b6ec-83233405b633 req-08c15999-9ffb-48f4-97ef-74d542a75ad8 service nova] Creating event network-changed:c0b078a2-1c95-4a1f-a09a-bc30f5710e7c for instance 96e97534-d604-4593-8ebd-af7e01f58d5a on hv-cinder-82880 Aug 30 14:52:26.194405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-37a3e886-8cf1-4164-b6ec-83233405b633 req-08c15999-9ffb-48f4-97ef-74d542a75ad8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095236 Aug 30 14:52:26.195074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 471/923] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:27.161987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:27.164221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:27.170839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:27.172294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:27.173568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:27.175445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:27.176283 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:27.177006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:27.225761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-51099d36-5503-46e7-9f8a-dccdefd2721f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067725 Aug 30 14:52:27.226684 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 453/924] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:27 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:28.244725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:28.248043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:28.255665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.256185 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.256622 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.257317 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.257769 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.258221 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.290050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3958d589-81e6-43a4-b861-5f4970f2f233 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053905 Aug 30 14:52:28.290628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 472/925] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:28 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:52:28.353982 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:28.354498 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:28.361154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.361637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.362064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.362754 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.363205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.363622 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.391554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:52:28.475588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3cc9e617-33eb-4a81-8c3e-4bef700331f3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 204 len: 0 microversion: 2.1 time: 0.125249 Aug 30 14:52:28.476197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 454/926] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:52:28 2022] DELETE /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:52:28.485407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:28.485700 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:28.494724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.495292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.495969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.497184 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.497944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.498631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.653411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:28.665580 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b2584e9e-9389-4467-86e6-7dd75235db85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1682 microversion: 2.1 time: 0.184241 Aug 30 14:52:28.666329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 473/927] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:28 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:29.691838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:29.692578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:29.695030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:29.700789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:29.701268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:29.701703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:29.702377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:29.702827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:29.703248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:29.922715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:29.931905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7545622d-a070-4e0e-bb74-a263c2bc639e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1682 microversion: 2.1 time: 0.244406 Aug 30 14:52:29.932535 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 455/928] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:29 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:30.746286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-228a54e2-dff5-4af0-b854-79c2fa9bedaa req-f843e9da-05e4-48aa-9176-be67ba2eaef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bec4834-0075-439c-bca0-5c5abf786d13", "name": "network-vif-deleted", "tag": "886589e5-9a1e-4347-ba30-b804fb5e471a"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:30.754475 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:30.762009 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-228a54e2-dff5-4af0-b854-79c2fa9bedaa req-f843e9da-05e4-48aa-9176-be67ba2eaef4 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:30.762513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-228a54e2-dff5-4af0-b854-79c2fa9bedaa req-f843e9da-05e4-48aa-9176-be67ba2eaef4 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:30.763301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-228a54e2-dff5-4af0-b854-79c2fa9bedaa req-f843e9da-05e4-48aa-9176-be67ba2eaef4 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:30.779151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-228a54e2-dff5-4af0-b854-79c2fa9bedaa req-f843e9da-05e4-48aa-9176-be67ba2eaef4 service nova] Creating event network-vif-deleted:886589e5-9a1e-4347-ba30-b804fb5e471a for instance 6bec4834-0075-439c-bca0-5c5abf786d13 on hv-cinder-82880 Aug 30 14:52:30.786020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-228a54e2-dff5-4af0-b854-79c2fa9bedaa req-f843e9da-05e4-48aa-9176-be67ba2eaef4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043681 Aug 30 14:52:30.786825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 474/929] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:30.965928 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:30.966529 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:30.974903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:30.975385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:30.976088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:30.976981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:30.977625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:30.978046 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:31.011216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:31.011693 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:31.012140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:31.012579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'fault' on Instance uuid 6bec4834-0075-439c-bca0-5c5abf786d13 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:31.057890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:31.065901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-052e7044-393d-447c-921a-52f94689a90c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 200 len: 1331 microversion: 2.1 time: 0.104121 Aug 30 14:52:31.066490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 456/930] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:30 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:32.089225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:32.089853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:32.099164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:32.099764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:32.100117 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:32.100809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:32.101280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:32.101702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:32.117721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 HTTP/1.1 Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:52:32.119971 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:52:32.121663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '6bec4834-0075-439c-bca0-5c5abf786d13'} Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:32.122555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:52:32.124190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:32.125744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:32.125744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f94df49f-28fa-41cc-bf79-35f7ae7c774f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 404 len: 111 microversion: 2.1 time: 0.036642 Aug 30 14:52:32.125744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 475/931] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:32 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:52:32.131363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b41ac775-4fc0-4894-87e9-af6c76d6dcf6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '.version_select at 0x7fe6a62ca790>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:32.162985 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b41ac775-4fc0-4894-87e9-af6c76d6dcf6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098619881" status: 202 len: 0 microversion: 2.1 time: 0.035450 Aug 30 14:52:32.163591 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 457/932] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 14:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098619881 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:32.893868 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0194c437-426d-49ae-885b-e032ab038704 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: .version_select at 0x7fe6a62aa430>, body: {"keypair": {"name": "tempest-keypair-2012990227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNY5jQqfGGFlqEu90tJSZw8ik4hGxy0YiaINcHS1FufQ4m6ugWedFoaOkqCohHR5NdoVIfvokSnqHMOmFUOlRIG11QbzgH1lfLypceBef0tdcvo/CDTZjaG6iz/CoBUB9g=="}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:32.909674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-0194c437-426d-49ae-885b-e032ab038704 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:52:32.913814 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-0194c437-426d-49ae-885b-e032ab038704 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:52:32.938887 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0194c437-426d-49ae-885b-e032ab038704 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049062 Aug 30 14:52:32.939500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 476/933] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:52:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:33.708449 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:33.709606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:33.719101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:33.719676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:33.720129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:33.722922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:33.723625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:33.724063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:33.767208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:52:33.863651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9fd4d3b9-d1f9-478d-9981-e47136facb95 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 204 len: 0 microversion: 2.1 time: 0.159668 Aug 30 14:52:33.864699 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 458/934] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:52:33 2022] DELETE /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:52:33.876951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:33.878786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:33.888772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:33.889271 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:33.889902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:33.890624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:33.891066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:33.891919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:34.052467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:34.061487 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b244bd2e-aaa9-459e-b437-7b9310dd68d5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1577 microversion: 2.1 time: 0.191709 Aug 30 14:52:34.062078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 477/935] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:33 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:34.366890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448713753", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f"}], "security_groups": [{"name": "tempest-securitygroup--922250633"}], "key_name": "tempest-keypair-2012990227", "user_data": "}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:34.490194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] validate_networks() for [('d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:52:35.087153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:35.087802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:35.095429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:35.095912 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:35.096615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:35.097332 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:35.097779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:35.098199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:35.218571 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:52:35.220135 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:52:35.220405 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:52:35.221494 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:52:35.222211 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:52:35.237753 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:35.238376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:35.238864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:35.239825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:35.240451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:35.241410 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:35.268729 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:52:35.274758 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:52:35.279607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:35.287909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:52:35.290388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:52:35.292459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0877abb2-23e8-4841-854e-0ca6241b0836 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1577 microversion: 2.1 time: 0.209881 Aug 30 14:52:35.293646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 478/936] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:35 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:35.349624 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2f9b8bcb-0478-4516-b49a-aa05aa4aa878 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.987468 Aug 30 14:52:35.350273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 459/937] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:52:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:52:35.361547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7b2f6f05-a0f4-47e4-92e6-2749627f9903 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:35.362455 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7b2f6f05-a0f4-47e4-92e6-2749627f9903 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:35.417151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7b2f6f05-a0f4-47e4-92e6-2749627f9903 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:35.425530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7b2f6f05-a0f4-47e4-92e6-2749627f9903 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1242 microversion: 2.1 time: 0.067853 Aug 30 14:52:35.426445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 479/938] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:35 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:36.318181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:36.318822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:36.325434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:36.325804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:36.326226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:36.326917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:36.327332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:36.327770 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:36.454908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c075aaa7-399e-49aa-b3d7-a7f4aed5640f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:36.456206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c075aaa7-399e-49aa-b3d7-a7f4aed5640f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:36.554854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c075aaa7-399e-49aa-b3d7-a7f4aed5640f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:36.565560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c075aaa7-399e-49aa-b3d7-a7f4aed5640f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1242 microversion: 2.1 time: 0.115054 Aug 30 14:52:36.565560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 480/939] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:36 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:36.622411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:36.631386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5ffa0462-b60b-4be3-82ff-1e5f2cff260f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1577 microversion: 2.1 time: 0.318135 Aug 30 14:52:36.631984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 460/940] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:36 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1577 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:37.055150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-79ed0bb2-6e4a-4649-b87f-67c463c01b9f req-7bfc7185-87bd-47d1-bdfe-960fff1aae55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74db9a17-f60a-45f7-a911-343fc374f92f", "name": "network-vif-deleted", "tag": "a08e9383-4f8e-4d27-aa7a-f0a442fb1d85"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:37.066618 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-79ed0bb2-6e4a-4649-b87f-67c463c01b9f req-7bfc7185-87bd-47d1-bdfe-960fff1aae55 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:37.067097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-79ed0bb2-6e4a-4649-b87f-67c463c01b9f req-7bfc7185-87bd-47d1-bdfe-960fff1aae55 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:37.067542 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-79ed0bb2-6e4a-4649-b87f-67c463c01b9f req-7bfc7185-87bd-47d1-bdfe-960fff1aae55 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:37.081076 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-79ed0bb2-6e4a-4649-b87f-67c463c01b9f req-7bfc7185-87bd-47d1-bdfe-960fff1aae55 service nova] Creating event network-vif-deleted:a08e9383-4f8e-4d27-aa7a-f0a442fb1d85 for instance 74db9a17-f60a-45f7-a911-343fc374f92f on hv-cinder-82880 Aug 30 14:52:37.091188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-79ed0bb2-6e4a-4649-b87f-67c463c01b9f req-7bfc7185-87bd-47d1-bdfe-960fff1aae55 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041156 Aug 30 14:52:37.092182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 481/941] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:37.588355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-09dbac05-e91d-4e92-b52f-a7f499d7066e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:37.589626 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-09dbac05-e91d-4e92-b52f-a7f499d7066e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:37.660835 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:37.661637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:37.662207 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-09dbac05-e91d-4e92-b52f-a7f499d7066e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:37.669040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:37.670172 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:37.671241 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:37.672512 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:37.673379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:37.673509 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-09dbac05-e91d-4e92-b52f-a7f499d7066e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1242 microversion: 2.1 time: 0.088569 Aug 30 14:52:37.674119 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 461/942] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:37 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:37.674408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:37.717788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:37.718423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:37.718862 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:37.720588 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lazy-loading 'fault' on Instance uuid 74db9a17-f60a-45f7-a911-343fc374f92f {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:37.780040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:37.793763 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-822ef894-a4d8-4f72-844d-c44e72a204ec tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 200 len: 1230 microversion: 2.1 time: 0.142848 Aug 30 14:52:37.794776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 482/943] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:37 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 1230 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:38.695411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fa611fe6-005d-4c69-a663-4263f647642c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:38.696105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fa611fe6-005d-4c69-a663-4263f647642c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:38.720549 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-407758621"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:38.721086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:38.730696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:38.731464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:38.732278 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:38.733572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:38.735049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:38.735851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:38.784301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-fa611fe6-005d-4c69-a663-4263f647642c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:38.791983 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fa611fe6-005d-4c69-a663-4263f647642c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1242 microversion: 2.1 time: 0.100741 Aug 30 14:52:38.792848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 483/944] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:38 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:38.822020 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:38.822705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:38.829133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:38.829795 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:38.830239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:38.830948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:38.831413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:38.831842 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:38.852132 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] HTTP exception thrown: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Request method failure captured: Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f HTTP/1.1 Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiMUaOd6bwCeOVB0IyBSLu-XRvG3fE6Bb9AwmXNe_rjf2yc2I1J8w1hqBxvoJDm3ayhFITVYkiLLfW305GxYNvKQ9sZBodpd_H1fPPLFCvOLpYX2fG8YVnMb4_bWuE_NJE8jGqjtzZ3ajFSMuv9ae9Bv7Ovkx0aCrQ0xhJctE_rqu0Q Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:52:38.853972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86111e1d9f5b485abf57231b21b3a5e9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-TestVolumeBootPattern-122287709 Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 06ab23cfa18e47c9871c6f451b871ef2 Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:52:38.856787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '74db9a17-f60a-45f7-a911-343fc374f92f'} Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:38.857707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:52:38.859333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:38.860899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Returning 404 to user: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:38.860899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8d5cbca1-716a-489f-abc4-22fdc79c9d5f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 404 len: 111 microversion: 2.1 time: 0.038058 Aug 30 14:52:38.860899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 484/945] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:38 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:52:38.926228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.network.security_group_api [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Removing security group d7bfd76c-3b55-44fd-a207-38e200256933 from port 649219cb-9d47-46d0-bb79-dbd9ce7a2960 Aug 30 14:52:38.987218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-611363459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-495216325", "security_groups": [{"name": "tempest-secgroup-smoke-1433722321"}], "block_device_mapping_v2": [{"uuid": "dfcd8e6f-c53c-4553-8b23-dc7c0d5f0b96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47a984e3-6912-4cff-bbe4-e504a54d421e"}]}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:39.151423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] validate_networks() for [('47a984e3-6912-4cff-bbe4-e504a54d421e', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:52:39.478904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-20092d90-9908-45a1-88b0-1ca636ca9e26 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/action" status: 202 len: 0 microversion: 2.1 time: 0.883728 Aug 30 14:52:39.479634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 462/946] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:52:38 2022] POST /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/action => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:39.497586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-f5a61df6-dc92-4e8b-8da3-ead401eafe7a req-dd7f622f-3ed9-41bf-84be-771970a25e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e57929-37de-4ea1-b61a-01b83a906ad1", "tag": "649219cb-9d47-46d0-bb79-dbd9ce7a2960"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:39.514931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f5a61df6-dc92-4e8b-8da3-ead401eafe7a req-dd7f622f-3ed9-41bf-84be-771970a25e53 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:39.515804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f5a61df6-dc92-4e8b-8da3-ead401eafe7a req-dd7f622f-3ed9-41bf-84be-771970a25e53 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:39.516473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f5a61df6-dc92-4e8b-8da3-ead401eafe7a req-dd7f622f-3ed9-41bf-84be-771970a25e53 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:39.531886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-f5a61df6-dc92-4e8b-8da3-ead401eafe7a req-dd7f622f-3ed9-41bf-84be-771970a25e53 service nova] Creating event network-changed:649219cb-9d47-46d0-bb79-dbd9ce7a2960 for instance a8e57929-37de-4ea1-b61a-01b83a906ad1 on hv-cinder-82880 Aug 30 14:52:39.539838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-f5a61df6-dc92-4e8b-8da3-ead401eafe7a req-dd7f622f-3ed9-41bf-84be-771970a25e53 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046249 Aug 30 14:52:39.541669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 463/947] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:39.817601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:39.818620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:39.828623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:39.829531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:39.830158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:39.832525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:39.833377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:39.833964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:39.862875 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:52:39.863941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:52:39.864490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:52:39.864926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:52:39.865547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:52:39.878261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:39.879253 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:39.879751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:39.880910 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:39.882218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:39.882218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:39.903642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:52:39.908899 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for user 06ab23cfa18e47c9871c6f451b871ef2 and project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:52:39.971975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:39.983956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:52:39.984476 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4c701237-0cee-4faf-9d7f-a743eb304d6f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1246 microversion: 2.1 time: 0.174520 Aug 30 14:52:39.985086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 464/948] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:39 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1246 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:39.987631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dfcd8e6f-c53c-4553-8b23-dc7c0d5f0b96',volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:52:40.185418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [7ab14d0c-d1e5-41d0-a60f-5e20e0d614ba] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 14:52:40.425132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:40.429287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:40.440251 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.440785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.441354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.442227 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.442625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.443051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.479397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-313e8cc0-abc4-46af-880a-effed230d9ab tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060454 Aug 30 14:52:40.479850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 465/949] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:40 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 14:52:40.548388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:40.548975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:40.555560 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.556073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.556576 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.557194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.557665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.558078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.584782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:52:40.614528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:40.666973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5da3f3bb-542b-47fd-96b3-776d21eb6f63 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 204 len: 0 microversion: 2.1 time: 0.122687 Aug 30 14:52:40.667719 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 466/950] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:52:40 2022] DELETE /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:52:40.676667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:40.677352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:40.683556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.684060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.684483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.685218 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.685661 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.686071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.824757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:40.840496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-513fb73a-f9d5-477c-8451-9b310c1c7c21 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1673 microversion: 2.1 time: 0.167829 Aug 30 14:52:40.841544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 467/951] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:40 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:40.857176 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:40.857810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:40.863938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.864511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.865002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.865618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.866057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.866490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.963298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lazy-loading 'services' on Instance uuid a8e57929-37de-4ea1-b61a-01b83a906ad1 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:41.090992 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a601546f-7f5d-43b1-9a9e-9441784fcad7 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments/cb64c926-1c31-4f91-817b-a6c5566fa73a" status: 202 len: 0 microversion: 2.1 time: 0.238493 Aug 30 14:52:41.091588 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 468/952] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:52:40 2022] DELETE /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments/cb64c926-1c31-4f91-817b-a6c5566fa73a => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 14:52:41.097659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-76a1fc48-1a0c-4d29-813b-c1c1cd1bda2e req-abb0cb6a-61f0-4f85-a92d-b36678b428fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e57929-37de-4ea1-b61a-01b83a906ad1", "tag": "649219cb-9d47-46d0-bb79-dbd9ce7a2960"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:41.107697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-76a1fc48-1a0c-4d29-813b-c1c1cd1bda2e req-abb0cb6a-61f0-4f85-a92d-b36678b428fe service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.108219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-76a1fc48-1a0c-4d29-813b-c1c1cd1bda2e req-abb0cb6a-61f0-4f85-a92d-b36678b428fe service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.108651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-76a1fc48-1a0c-4d29-813b-c1c1cd1bda2e req-abb0cb6a-61f0-4f85-a92d-b36678b428fe service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.121667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-76a1fc48-1a0c-4d29-813b-c1c1cd1bda2e req-abb0cb6a-61f0-4f85-a92d-b36678b428fe service nova] Creating event network-changed:649219cb-9d47-46d0-bb79-dbd9ce7a2960 for instance a8e57929-37de-4ea1-b61a-01b83a906ad1 on hv-cinder-82880 Aug 30 14:52:41.126961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-76a1fc48-1a0c-4d29-813b-c1c1cd1bda2e req-abb0cb6a-61f0-4f85-a92d-b36678b428fe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033668 Aug 30 14:52:41.127537 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 469/953] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:41.132638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:41.133325 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:41.139579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.140074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.140518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.141214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.141654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.142818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.194735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO oslo.messaging._drivers.impl_rabbit [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [7ab14d0c-d1e5-41d0-a60f-5e20e0d614ba] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 41672. Aug 30 14:52:41.199609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e6166b95-22ee-4d98-b413-206fefbb5417 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.220489 Aug 30 14:52:41.200447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 485/954] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:52:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:52:41.211049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:41.213367 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:41.227219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:41.227389 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.227776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.228239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.228936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.229663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.230078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.241974 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aa7fb392-07e4-41e8-8ed7-829558b99a2e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1302 microversion: 2.1 time: 0.113159 Aug 30 14:52:41.243538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 470/955] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:41 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1302 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:41.249749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3e3a76ca-ac52-4a1a-a7fc-a970d8028d18 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:41.250773 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e3a76ca-ac52-4a1a-a7fc-a970d8028d18 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:41.273702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-005a9558-ba0b-41fa-af03-bcc126be44d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072329 Aug 30 14:52:41.274600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 486/956] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:41 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:41.311662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3e3a76ca-ac52-4a1a-a7fc-a970d8028d18 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:41.319815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3e3a76ca-ac52-4a1a-a7fc-a970d8028d18 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1093 microversion: 2.1 time: 0.074924 Aug 30 14:52:41.324083 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 471/957] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:41 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:41.867688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:41.868506 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:41.877299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.877299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.877299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.877760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.877955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.878609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.177642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:42.187809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-decc0ae9-0699-4697-a240-6554e364b7d5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1673 microversion: 2.1 time: 0.325166 Aug 30 14:52:42.188558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 487/958] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:41 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1673 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:42.265863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:42.266450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:42.274200 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.274692 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.275155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.275836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.276328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.276752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.286653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:42.289631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:42.299006 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.299830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.300665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.301923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.302727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.303484 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.344357 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5718c1f0-d733-4c29-83ac-ed6d546ec034 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061662 Aug 30 14:52:42.345156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 488/959] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:42 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:42.345417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:42.349973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:42.350580 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:42.355447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a3f3f7b1-f467-4471-9d29-dfc2a2cb4a9a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1300 microversion: 2.1 time: 0.093537 Aug 30 14:52:42.356334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 472/960] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:42 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:42.357272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.357757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.358189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.358895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.359338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.359756 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.364934 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:42.429842 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:42.437636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-333feb93-ae02-42aa-87dd-f785f6599594 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1135 microversion: 2.1 time: 0.091598 Aug 30 14:52:42.438164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 489/961] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:42 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1135 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:43.214453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:43.214901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:43.223633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.234515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.236156 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.237108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.240410 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.242428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.359327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:43.363251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:43.370893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.371464 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.372149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.372985 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.373512 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.374188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.414072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-81a3a46d-49cb-43f7-9291-701bc5925003 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060919 Aug 30 14:52:43.414972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 490/962] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:43 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:52:43.420021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:43.420647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:43.427945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.428465 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.429728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.430007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.430452 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.430870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.787197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:43.795687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b1b1d74c-04f2-47de-a79f-726fc3f2a1e7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1300 microversion: 2.1 time: 0.379467 Aug 30 14:52:43.810022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 491/963] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:43 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1300 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:43.815634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:43.816576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:43.823167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.823959 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.824596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.825491 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.826106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.826675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.996759 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:44.006964 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-58bdae19-ad1e-437d-8d4c-e2635947f2bf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1209 microversion: 2.1 time: 0.195350 Aug 30 14:52:44.022575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 492/964] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:43 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:44.110548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:44.121667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-366de9ab-8131-4105-bdab-a6a8ff502042 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1673 microversion: 2.1 time: 0.910736 Aug 30 14:52:44.122787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 473/965] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:43 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1673 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:44.432790 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:44.438333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:44.447039 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:44.448265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:44.448989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:44.450762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:44.451501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:44.452252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:44.493097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-dd46b822-fa67-4694-975a-be57de0cfa69 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066083 Aug 30 14:52:44.493830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 493/966] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:44 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:52:44.505512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:44.505999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:44.514678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:44.515459 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:44.516078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:44.517818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:44.518518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:44.518949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:44.766765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] HTTP exception thrown: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 is not attached to volume cb64c926-1c31-4f91-817b-a6c5566fa73a Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Request method failure captured: Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments/cb64c926-1c31-4f91-817b-a6c5566fa73a HTTP/1.1 Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiL9IftO_QNAmsUHgV5DoIAC0zgjGPIjedt-bC9KL9YPbea5LQ-7-8SpMjHQLW0B1YjiJPwi2ZW5f9wNEzZrMbOvbEaZDbkQZ26RaUGOjeRAUBi9WAfcTm91NEaYidwbzg8Og-A4Yv3bao7flSPafLT4Ew4FiEeONJcOIBHTzU4hAXQ Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 30338c95ad8d476b89bbec65ad188b2d Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestMinimumBasicScenario-176471600 Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:52:44.774019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30338c95ad8d476b89bbec65ad188b2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30338c95ad8d476b89bbec65ad188b2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30338c95ad8d476b89bbec65ad188b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30338c95ad8d476b89bbec65ad188b2d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestMinimumBasicScenario-176471600 Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 30338c95ad8d476b89bbec65ad188b2d Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176471600 Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-TestMinimumBasicScenario-176471600-project Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: eb1aa3917d3d427e91f0805e5d6ab4eb Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestMinimumBasicScenario-176471600-project Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:52:44.777100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 is not attached to volume cb64c926-1c31-4f91-817b-a6c5566fa73a Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'server_id': 'a8e57929-37de-4ea1-b61a-01b83a906ad1', 'id': 'cb64c926-1c31-4f91-817b-a6c5566fa73a'} Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cb64c926-1c31-4f91-817b-a6c5566fa73a. Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:44.778470 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 is not attached to volume cb64c926-1c31-4f91-817b-a6c5566fa73a Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 is not attached to volume cb64c926-1c31-4f91-817b-a6c5566fa73a Aug 30 14:52:44.781453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:44.788889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Returning 404 to user: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 is not attached to volume cb64c926-1c31-4f91-817b-a6c5566fa73a {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:44.788889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2c87b1cc-7385-450e-9ab2-6c551e1e99bb tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments/cb64c926-1c31-4f91-817b-a6c5566fa73a" status: 404 len: 154 microversion: 2.1 time: 0.286098 Aug 30 14:52:44.788889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 474/967] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:52:44 2022] DELETE /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1/os-volume_attachments/cb64c926-1c31-4f91-817b-a6c5566fa73a => generated 154 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 14:52:44.824051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:44.825087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:44.857786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:44.858581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:44.859300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:44.860606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:44.877266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:44.878064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.032953 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:45.033838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:45.042491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.043110 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.043701 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.044518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.045163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.045863 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.256928 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:45.544321 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:45.555734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1b3edd18-b261-4020-981f-01082c613b33 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.740625 Aug 30 14:52:45.561604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 494/968] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:44 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:45.564756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:45.573147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:45.574648 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:45.574840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-61d6603c-f584-4c76-94cf-6b1a22c6b69a tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.548047 Aug 30 14:52:45.575284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 475/969] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:45 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:45.592285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.593477 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.594515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.595188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.595938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.596601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.704784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:45.718204 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3aa8cb3f-daaa-4986-87d1-aee0328febfa tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1605 microversion: 2.1 time: 0.154676 Aug 30 14:52:45.719226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 495/970] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:45 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1605 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:45.728916 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-e98e5a40-8f41-44ee-aefb-45b6cbac54e5 req-c8b7ca24-fac4-4aaf-bd3c-bbf0d8201f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e6f700-d63f-4672-80f4-1ff6f5d17c85", "name": "network-vif-deleted", "tag": "3e9a727d-00f3-4b12-a9e6-544c28dd320e"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:45.739893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e98e5a40-8f41-44ee-aefb-45b6cbac54e5 req-c8b7ca24-fac4-4aaf-bd3c-bbf0d8201f6a service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.740816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e98e5a40-8f41-44ee-aefb-45b6cbac54e5 req-c8b7ca24-fac4-4aaf-bd3c-bbf0d8201f6a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.741321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e98e5a40-8f41-44ee-aefb-45b6cbac54e5 req-c8b7ca24-fac4-4aaf-bd3c-bbf0d8201f6a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.761832 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-e98e5a40-8f41-44ee-aefb-45b6cbac54e5 req-c8b7ca24-fac4-4aaf-bd3c-bbf0d8201f6a service nova] Creating event network-vif-deleted:3e9a727d-00f3-4b12-a9e6-544c28dd320e for instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 on hv-cinder-82880 Aug 30 14:52:45.771705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-e98e5a40-8f41-44ee-aefb-45b6cbac54e5 req-c8b7ca24-fac4-4aaf-bd3c-bbf0d8201f6a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Aug 30 14:52:45.773236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 476/971] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:45.805297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-0941717a-3fda-41c8-bec9-3de7e2f2d0cb req-f8b45af2-fbb8-4223-bab6-5aa538114f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeabde5d-dfc1-47a8-a15b-47938a678196", "tag": "7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:45.825240 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-0941717a-3fda-41c8-bec9-3de7e2f2d0cb req-f8b45af2-fbb8-4223-bab6-5aa538114f3d service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.825836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-0941717a-3fda-41c8-bec9-3de7e2f2d0cb req-f8b45af2-fbb8-4223-bab6-5aa538114f3d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.826340 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-0941717a-3fda-41c8-bec9-3de7e2f2d0cb req-f8b45af2-fbb8-4223-bab6-5aa538114f3d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.852256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-0941717a-3fda-41c8-bec9-3de7e2f2d0cb req-f8b45af2-fbb8-4223-bab6-5aa538114f3d service nova] Creating event network-changed:7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6 for instance aeabde5d-dfc1-47a8-a15b-47938a678196 on hv-cinder-82880 Aug 30 14:52:45.859749 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-0941717a-3fda-41c8-bec9-3de7e2f2d0cb req-f8b45af2-fbb8-4223-bab6-5aa538114f3d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058507 Aug 30 14:52:45.861116 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 496/972] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:52:46.187768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:46.194676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:46.196392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.196900 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.197700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.198965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.199650 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.200326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.240636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:52:46.350268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-23901ec1-5917-4bc5-83ed-1989fb542730 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 204 len: 0 microversion: 2.1 time: 0.167422 Aug 30 14:52:46.352892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 477/973] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:52:46 2022] DELETE /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:52:46.362854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:46.363629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:46.380345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.381360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.381959 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.383192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.385283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.385721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.537300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:46.545944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0c686b4b-2ecc-46d4-998f-2acbba22f3f9 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1554 microversion: 2.1 time: 0.187716 Aug 30 14:52:46.546728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 497/974] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:46 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:46.580762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:46.581904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:46.589278 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.589864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.590430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.591113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.591769 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.592091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.600167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:46.600826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:46.608678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.609243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.609857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.610855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.611565 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.612015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.819776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:46.824866 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:46.834236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d3c54909-64cb-4a90-bed3-cb64310774e5 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.238781 Aug 30 14:52:46.834448 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4017c83b-74ab-4bfc-b26b-02731b18e427 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.258305 Aug 30 14:52:46.834818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 498/975] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:46 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:46.835208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 478/976] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:46 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:46.841328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:46.842023 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:46.849141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.849733 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.850228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.850995 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.851639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.852185 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.887437 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.887921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.888380 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.888829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lazy-loading 'fault' on Instance uuid c9e6f700-d63f-4672-80f4-1ff6f5d17c85 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:46.937061 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:46.946539 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ea756be7-20e4-495e-adae-13266659f5a6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1326 microversion: 2.1 time: 0.109556 Aug 30 14:52:46.947560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 499/977] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:46 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:47.568716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:47.569286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:47.577887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.578627 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.579141 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.580356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.580811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.581233 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.728355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:47.740140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c08618e0-5a75-4c1f-80be-f4d169549934 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1554 microversion: 2.1 time: 0.175305 Aug 30 14:52:47.740716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 479/978] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:47 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:47.787266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-c1db698e-fd35-47a9-8e68-45e6a900ac27 req-cc7c064f-ba5a-4adc-a787-614ff2324682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0b4a87-5efc-4610-a9a7-267fe31ce059", "tag": "66081a2c-816c-4ce3-a352-e7d4a5e250ab"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:47.798525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c1db698e-fd35-47a9-8e68-45e6a900ac27 req-cc7c064f-ba5a-4adc-a787-614ff2324682 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.799297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c1db698e-fd35-47a9-8e68-45e6a900ac27 req-cc7c064f-ba5a-4adc-a787-614ff2324682 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.799798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-c1db698e-fd35-47a9-8e68-45e6a900ac27 req-cc7c064f-ba5a-4adc-a787-614ff2324682 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.817216 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-c1db698e-fd35-47a9-8e68-45e6a900ac27 req-cc7c064f-ba5a-4adc-a787-614ff2324682 service nova] Creating event network-changed:66081a2c-816c-4ce3-a352-e7d4a5e250ab for instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 on hv-cinder-82880 Aug 30 14:52:47.821990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-c1db698e-fd35-47a9-8e68-45e6a900ac27 req-cc7c064f-ba5a-4adc-a787-614ff2324682 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038662 Aug 30 14:52:47.822561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 500/979] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:47.855145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:47.855754 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:47.856609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:47.857298 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:47.862350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.862877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.863307 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.864033 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.864411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.864559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.864915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.865059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.865356 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.866017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.866499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.866906 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:48.064572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:48.067659 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:48.076984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-73f63abb-061d-41dc-a4e9-de9799d81380 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.224611 Aug 30 14:52:48.077213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-710fb1c2-73ad-4649-a175-74d80c72607b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.225426 Aug 30 14:52:48.087471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 501/980] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:47 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:48.087709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 480/981] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:47 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:48.087808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:48.087808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:48.098525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:48.099021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:48.099457 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:48.100203 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:48.100656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:48.101076 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:48.136801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:48.137561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:48.138153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:48.138803 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lazy-loading 'fault' on Instance uuid c9e6f700-d63f-4672-80f4-1ff6f5d17c85 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:48.228286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:48.237686 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-456b64a6-7f40-4195-a994-39e1076b0737 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1326 microversion: 2.1 time: 0.158513 Aug 30 14:52:48.238285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 502/982] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:48 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1326 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:48.764483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:48.765084 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:48.772665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:48.773149 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:48.773547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:48.774234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:48.774672 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:48.775083 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.099492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:49.100240 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:49.107437 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.107924 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.108390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.109097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.109545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.109960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.273419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:49.281913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cfda1b95-e7ec-4cd7-842f-f0ebd9104a88 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1554 microversion: 2.1 time: 0.523389 Aug 30 14:52:49.282491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 481/983] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:48 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1554 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:49.295587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:49.295587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:49.295587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.295587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.296122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.296122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.296302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.296732 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.316175 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:49.324795 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:49.333164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4460bbd3-1e27-4b97-a27d-e3e8b3eb0bb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.238168 Aug 30 14:52:49.334011 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 503/984] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:49 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:49.339082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:49.339670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:49.346700 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.347200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.347711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.348494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.348956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.349384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.379096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:49.385635 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.386221 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.386645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.387092 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lazy-loading 'fault' on Instance uuid c9e6f700-d63f-4672-80f4-1ff6f5d17c85 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:49.452463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:49.461130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:49.461930 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4dacc0a9-e5fd-42ea-83eb-fd13654ff458 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 200 len: 1326 microversion: 2.1 time: 0.126756 Aug 30 14:52:49.462524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 504/985] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:49 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:49.475523 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bda8bed6-b6f4-40ce-8a28-31d948c8b7fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.191870 Aug 30 14:52:49.476126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 482/986] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:49 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:50.304111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:50.304671 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:50.306928 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:50.307598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=16 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:50.314169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.315014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.315014 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.315727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.316195 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.316611 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.353451 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:50.354324 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:50.362102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.362102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.362461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.363154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.363826 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.364330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.525693 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:50.534914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d2f74339-762e-4aab-80f8-3f82ae8f91d5 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1554 microversion: 2.1 time: 0.235068 Aug 30 14:52:50.535532 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 505/987] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:50 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:50.540546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:50.541217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:50.547628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.548139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.548702 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.550144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.550605 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.550997 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.556124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:50.562898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:50.567092 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] HTTP exception thrown: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Request method failure captured: Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 HTTP/1.1 Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJBJwQK1PBbBS8-P8BBVARGo6lKqSN9ie5zmHZQRsZSxDnKDIlUOom35d9E6AGDxUlG5tYi2EiSz-sdn8TK-nY4ODwkEbRchXB42GrSBS1IpNJ_HmHG4kyfvnM1dmF_3KpGCMS6vILPajQ9AUZNyXiaKBWwT4_LH4-Fhqk0RWX6ILA Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:52:50.568836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa5fb93320db4b1a838bed8b14ca5653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: a1b3f34373414c61b94e2a8d9018cbd5 Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:52:50.570372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': 'c9e6f700-d63f-4672-80f4-1ff6f5d17c85'} Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:50.571143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:52:50.572909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:52:50.574745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Returning 404 to user: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:50.574745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-445ca14d-add5-4bce-b961-de58eb44bab4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 404 len: 111 microversion: 2.1 time: 0.033772 Aug 30 14:52:50.574745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 506/988] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:50 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:52:50.575128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0fbfba85-1454-41e5-bb2c-46fd4d95fe32 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.222470 Aug 30 14:52:50.575513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:50.576138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:50.582755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.583237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.583488 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 483/989] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:50 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:50.583658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.584383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.584880 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.585297 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.591385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5eba2740-ebf3-4041-b35f-375f337f1e84 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '.version_select at 0x7fe6a633d790>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:50.599598 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:50.614538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5eba2740-ebf3-4041-b35f-375f337f1e84 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964371602" status: 202 len: 0 microversion: 2.1 time: 0.029280 Aug 30 14:52:50.615383 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 484/990] 10.222.0.25 () {58 vars in 1218 bytes} [Tue Aug 30 14:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964371602 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:50.730508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:50.740047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-98841585-1053-4165-a649-099b1afa8f26 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.167880 Aug 30 14:52:50.740450 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 507/991] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:50 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:51.057461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:51.058334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:51.071266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.072212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.072988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.074424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.075076 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.075830 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.202336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'services' on Instance uuid d5552e35-b056-42a7-a699-e0f24a696704 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:51.284952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c6eedb62-ad7c-42b9-b4f3-e7d6851a9280 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments/42adbeb6-046f-4b08-8321-f3a6ea551af4" status: 202 len: 0 microversion: 2.1 time: 0.236122 Aug 30 14:52:51.285585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 485/992] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:52:51 2022] DELETE /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments/42adbeb6-046f-4b08-8321-f3a6ea551af4 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:51.295382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:51.297766 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:51.305825 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.306549 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.306785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.307463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.307921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.308434 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.322602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=10 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:51.327030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3bd3b301-ad54-4307-9418-5ddbdaf94838 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'create', calling method: .version_select at 0x7fe6a633d670>, body: {"keypair": {"name": "tempest-keypair-1395000057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq0bC9yd1A2OgJ+Jqc3p7iLA9cpDrn9lCwTBlFcLhV7EjEF9qtnF/V/MthtBKN/GtyYJWJaPa/tjTJN++wI2Nb5eBLBv09fJT8Bvy7S5rjf28666oy+fZkVP2I4ywU9eQ=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:51.343089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3bd3b301-ad54-4307-9418-5ddbdaf94838 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:52:51.347573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-3bd3b301-ad54-4307-9418-5ddbdaf94838 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for user a1b3f34373414c61b94e2a8d9018cbd5 and project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:52:51.349063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fec19dad-1321-45ae-876a-79b21ed71995 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057531 Aug 30 14:52:51.353965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 508/993] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:51 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:51.376074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3bd3b301-ad54-4307-9418-5ddbdaf94838 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054328 Aug 30 14:52:51.377066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 486/994] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:52:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:52:51.557770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:51.558382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:51.566562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.567161 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.567653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.568685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.569193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.569896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.594041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:51.594791 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:51.602555 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.603056 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.603487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.604234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.604676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.605356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.866804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:51.873290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:51.877832 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-104e29e4-ea76-4242-bad3-e0fef7c61bba tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1554 microversion: 2.1 time: 0.325071 Aug 30 14:52:51.878978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 509/995] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:51 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1554 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:51.884114 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:51.884735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:51.891148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.891641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.892301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.893336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.893834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.896190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.904123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e3aee98b-b304-4064-a0fb-eb825a215bde tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.313875 Aug 30 14:52:51.904887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 487/996] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:51 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:52.129929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:52.141052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-acc7db72-292c-4b39-a2c7-7ac1c1608377 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.260660 Aug 30 14:52:52.141718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 510/997] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:51 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:52.362139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:52.364952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:52.373160 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.373934 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.374364 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.375190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.375783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.376647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.429232 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e5810fd7-bb5f-40d0-ae3e-a23c2d02b685 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070926 Aug 30 14:52:52.429970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 488/998] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:52 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:52.859644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-5181266f-f2e8-40d0-961c-ee310276ee3c req-20aed145-54f5-4ec4-8428-e903fb347d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e57929-37de-4ea1-b61a-01b83a906ad1", "name": "network-vif-deleted", "tag": "649219cb-9d47-46d0-bb79-dbd9ce7a2960"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:52.871237 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5181266f-f2e8-40d0-961c-ee310276ee3c req-20aed145-54f5-4ec4-8428-e903fb347d33 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.871722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5181266f-f2e8-40d0-961c-ee310276ee3c req-20aed145-54f5-4ec4-8428-e903fb347d33 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.872200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-5181266f-f2e8-40d0-961c-ee310276ee3c req-20aed145-54f5-4ec4-8428-e903fb347d33 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.886156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-5181266f-f2e8-40d0-961c-ee310276ee3c req-20aed145-54f5-4ec4-8428-e903fb347d33 service nova] Creating event network-vif-deleted:649219cb-9d47-46d0-bb79-dbd9ce7a2960 for instance a8e57929-37de-4ea1-b61a-01b83a906ad1 on hv-cinder-82880 Aug 30 14:52:52.891147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-5181266f-f2e8-40d0-961c-ee310276ee3c req-20aed145-54f5-4ec4-8428-e903fb347d33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Aug 30 14:52:52.891921 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 511/999] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:52.902815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:52.903457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:52.910334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.910812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.911234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.911927 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.912426 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.912827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.933054 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:52.934469 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:52.942192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.943112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.943888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.945149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.945988 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.946734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:53.019635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:53.028058 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-42313e3c-089d-46db-92fd-c20243edfc2b tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1512 microversion: 2.1 time: 0.129105 Aug 30 14:52:53.028733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 489/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:52 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1512 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:53.163617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:53.164425 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:53.176359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:53.176359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:53.176359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:53.176359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:53.176780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:53.176780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:53.198740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:53.207620 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-659326d7-c12d-4aa3-9676-b3304f8fb934 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.279205 Aug 30 14:52:53.212335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 512/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:52 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:53.286042 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2133428781", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aee61467-aaf5-4b5d-929d-b8c24c2240c9"}], "security_groups": [{"name": "tempest-securitygroup--1016204701"}], "key_name": "tempest-keypair-1395000057", "user_data": "}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:53.586962 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] validate_networks() for [('aee61467-aaf5-4b5d-929d-b8c24c2240c9', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:52:53.728336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:53.736822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1a9a7292-86f9-46e4-b24e-0c0832c5295d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.577170 Aug 30 14:52:53.737975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 490/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:53 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:53.743346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:53.746114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:53.753696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:53.754347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:53.754781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:53.756171 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:53.756171 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:53.756570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:53.797165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4b32b28a-3a5f-45d9-915c-b864316bbc8f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057933 Aug 30 14:52:53.797733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 491/1003] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:53 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:54.059362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:54.061159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:54.072496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.073256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.074048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.075351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.076091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.077006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.120635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.121121 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.122662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.123230 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lazy-loading 'fault' on Instance uuid a8e57929-37de-4ea1-b61a-01b83a906ad1 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:54.247896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aa3917d3d427e91f0805e5d6ab4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30338c95ad8d476b89bbec65ad188b2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:54.257964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7fc2f341-8f32-40c6-8070-deed40ae2f89 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 200 len: 1348 microversion: 2.1 time: 0.206070 Aug 30 14:52:54.259243 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 492/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:54 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 1348 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:54.278096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:54.278983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:54.285677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.286422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.287036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.287745 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.288335 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.288766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.388323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:52:54.389320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:52:54.390078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:52:54.390722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:52:54.391283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:52:54.402144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.402919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.403728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.404670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.405121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.405687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.428321 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:52:54.433109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Getting quotas for user a1b3f34373414c61b94e2a8d9018cbd5 and project aa5fb93320db4b1a838bed8b14ca5653. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:52:54.445942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:52:54.448312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:52:54.472434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:54.496379 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3917085b-8916-4074-9eb9-e351bc55fd1c tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.222219 Aug 30 14:52:54.507731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 493/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:54 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:54.513234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e8876f6f-aab0-4bca-855c-1758e18fbe5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.232358 Aug 30 14:52:54.514143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 513/1006] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:52:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:52:54.536060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f37318d4-d4eb-4b91-a39b-f229042bb62b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:54.537071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f37318d4-d4eb-4b91-a39b-f229042bb62b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:54.683734 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f37318d4-d4eb-4b91-a39b-f229042bb62b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:54.696077 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f37318d4-d4eb-4b91-a39b-f229042bb62b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1238 microversion: 2.1 time: 0.174238 Aug 30 14:52:54.697215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 494/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:54 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1238 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:54.761756 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:54.762388 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:54.768816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.769309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.770645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.772129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.772586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.773035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.809819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:54.815514 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:54.824903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.825856 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.826905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.827920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.828619 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.829480 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.888477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f9bb12b4-b69b-4211-b155-0bb79ad42835 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082739 Aug 30 14:52:54.889620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 495/1008] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:54 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:52:54.998063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:54.998916 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:54.999422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:55.007845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c51bc75c-1c49-4e0f-97d4-881cb71fd0fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.250339 Aug 30 14:52:55.008354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.009217 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.009652 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.010414 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.011402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.012118 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.020714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 514/1009] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:54 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:55.042827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:52:55.141115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-705bae5a-85a1-44a0-80b2-ac361430b7a1 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 204 len: 0 microversion: 2.1 time: 0.146913 Aug 30 14:52:55.144947 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 496/1010] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:52:54 2022] DELETE /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:52:55.156719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:55.157448 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:55.164979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.165392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.166255 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.167213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.167752 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.168221 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.281308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:55.282002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] [instance: a8e57929-37de-4ea1-b61a-01b83a906ad1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:55.288492 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.288984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.289411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.290106 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.290551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.290965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.306143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] HTTP exception thrown: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 could not be found. Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Request method failure captured: Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 HTTP/1.1 Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiL9IftO_QNAmsUHgV5DoIAC0zgjGPIjedt-bC9KL9YPbea5LQ-7-8SpMjHQLW0B1YjiJPwi2ZW5f9wNEzZrMbOvbEaZDbkQZ26RaUGOjeRAUBi9WAfcTm91NEaYidwbzg8Og-A4Yv3bao7flSPafLT4Ew4FiEeONJcOIBHTzU4hAXQ Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 30338c95ad8d476b89bbec65ad188b2d Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestMinimumBasicScenario-176471600 Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:52:55.307804 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30338c95ad8d476b89bbec65ad188b2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/30338c95ad8d476b89bbec65ad188b2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/30338c95ad8d476b89bbec65ad188b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_30338c95ad8d476b89bbec65ad188b2d", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestMinimumBasicScenario-176471600 Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 30338c95ad8d476b89bbec65ad188b2d Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176471600 Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-TestMinimumBasicScenario-176471600-project Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: eb1aa3917d3d427e91f0805e5d6ab4eb Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestMinimumBasicScenario-176471600-project Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 could not be found. Aug 30 14:52:55.309418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'a8e57929-37de-4ea1-b61a-01b83a906ad1'} Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 could not be found. Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:52:55.310286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 could not be found. Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 could not be found. Aug 30 14:52:55.311544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:52:55.312703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Returning 404 to user: Instance a8e57929-37de-4ea1-b61a-01b83a906ad1 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:52:55.312703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-58b6276b-8818-410a-8935-315e5f5b12de tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1" status: 404 len: 111 microversion: 2.1 time: 0.032325 Aug 30 14:52:55.312703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 497/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:55 2022] GET /compute/v2.1/servers/a8e57929-37de-4ea1-b61a-01b83a906ad1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:52:55.322779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2a54a8c7-7acc-46d1-ae67-e375f9de32d3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] Calling method '.version_select at 0x7fe6a6353e50>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:55.323004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:55.331975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a85e621c-8990-4bb4-97ba-93a1ef5aa968 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1690 microversion: 2.1 time: 0.184332 Aug 30 14:52:55.332567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 515/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:55 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:55.343499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2a54a8c7-7acc-46d1-ae67-e375f9de32d3 tempest-TestMinimumBasicScenario-176471600 tempest-TestMinimumBasicScenario-176471600-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-757547522" status: 202 len: 0 microversion: 2.1 time: 0.024535 Aug 30 14:52:55.344248 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 498/1013] 10.222.0.25 () {58 vars in 1269 bytes} [Tue Aug 30 14:52:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-757547522 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:55.519274 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:55.519963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:55.526518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.527026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.527449 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.528181 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.528624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.529037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.686347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:55.697145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-689e64e8-e43b-4de8-b182-1609af8e5553 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.182297 Aug 30 14:52:55.698140 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 516/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:55 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:55.718220 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:55.718852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:55.726356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.726906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.727369 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.728340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.728793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.729236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.809879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:55.820020 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5842468d-6e95-468e-a8d1-019e643db763 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1234 microversion: 2.1 time: 0.106477 Aug 30 14:52:55.820634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 499/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:55 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:55.998175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-fc2d3194-9887-47f3-9db3-e8e98f92d65a req-eada6a99-e45b-4775-a034-98744963364a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0b4a87-5efc-4610-a9a7-267fe31ce059", "name": "network-vif-plugged", "status": "completed", "tag": "66081a2c-816c-4ce3-a352-e7d4a5e250ab"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:56.013215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-fc2d3194-9887-47f3-9db3-e8e98f92d65a req-eada6a99-e45b-4775-a034-98744963364a service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.013758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-fc2d3194-9887-47f3-9db3-e8e98f92d65a req-eada6a99-e45b-4775-a034-98744963364a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.014526 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-fc2d3194-9887-47f3-9db3-e8e98f92d65a req-eada6a99-e45b-4775-a034-98744963364a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.032766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:56.033604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-fc2d3194-9887-47f3-9db3-e8e98f92d65a req-eada6a99-e45b-4775-a034-98744963364a service nova] Creating event network-vif-plugged:66081a2c-816c-4ce3-a352-e7d4a5e250ab for instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 on hv-cinder-82880 Aug 30 14:52:56.034527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:56.042737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.043328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-fc2d3194-9887-47f3-9db3-e8e98f92d65a req-eada6a99-e45b-4775-a034-98744963364a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049392 Aug 30 14:52:56.044027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.044727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.045096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 517/1016] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:56.046065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.046879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.047382 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.226578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:56.236483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-34c893be-4538-4d4b-a9bf-bd6c1ed813ef tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.208691 Aug 30 14:52:56.237083 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 500/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:56 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:56.354121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:56.354816 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:56.362561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.363047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.363655 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.364387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.364883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.365290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.513886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:56.522466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c57e3a8c-017b-4690-be53-738b9a7769ff tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1690 microversion: 2.1 time: 0.172605 Aug 30 14:52:56.523775 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 518/1018] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:56 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:56.725978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:56.726611 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:56.734181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.735284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.736483 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.738788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.738788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.739191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.745320 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:56.847774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:56.848525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:56.854845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.855338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.855770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.856517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.856955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.857681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.901068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:56.909785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3aeab796-0547-46bb-b06a-d8e6ab8ef18f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.190659 Aug 30 14:52:56.911011 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 501/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:56 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:56.936818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:56.945220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-437749ef-a671-428b-ac08-aedbeebe7f29 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1234 microversion: 2.1 time: 0.101952 Aug 30 14:52:56.945818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 519/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:56 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1234 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:52:57.258935 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:57.260586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:57.268414 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.268757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.269198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:57.270420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.271165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.271799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:57.442675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:57.453004 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ca8b0e4c-95dd-4294-abb0-cd4db25f31a4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.198059 Aug 30 14:52:57.453792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 502/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:57 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:57.546015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:57.546574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:57.554534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.555325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.556066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:57.557569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.558015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.558402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:57.933954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:57.935736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:57.947841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.948789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.950490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:57.953088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.953913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.954949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.023181 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:58.038646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-50634f5d-7a06-4460-b979-6ebd4861c485 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1690 microversion: 2.1 time: 0.495321 Aug 30 14:52:58.039666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 520/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:57 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1690 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:58.044598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:58.045280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:58.051703 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:58.052295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:58.052836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.053956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:58.054488 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:58.055125 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.148255 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:58.160136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7420ecff-99ef-4ffc-917f-dc206af94780 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1234 microversion: 2.1 time: 0.117679 Aug 30 14:52:58.161919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 521/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:58 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1234 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:58.167500 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-2e06c226-3af3-4254-9158-e7b111226a67 req-e7546c9b-2a47-4393-8858-9e0fb5f4b5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeabde5d-dfc1-47a8-a15b-47938a678196", "name": "network-vif-plugged", "status": "completed", "tag": "7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:58.179805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2e06c226-3af3-4254-9158-e7b111226a67 req-e7546c9b-2a47-4393-8858-9e0fb5f4b5ae service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:58.181318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2e06c226-3af3-4254-9158-e7b111226a67 req-e7546c9b-2a47-4393-8858-9e0fb5f4b5ae service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:58.182202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2e06c226-3af3-4254-9158-e7b111226a67 req-e7546c9b-2a47-4393-8858-9e0fb5f4b5ae service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.199639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-2e06c226-3af3-4254-9158-e7b111226a67 req-e7546c9b-2a47-4393-8858-9e0fb5f4b5ae service nova] Creating event network-vif-plugged:7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6 for instance aeabde5d-dfc1-47a8-a15b-47938a678196 on hv-cinder-82880 Aug 30 14:52:58.206441 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-2e06c226-3af3-4254-9158-e7b111226a67 req-e7546c9b-2a47-4393-8858-9e0fb5f4b5ae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042428 Aug 30 14:52:58.207729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 522/1024] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:58.251224 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:58.271465 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5a4a197f-f101-4609-9ac9-2d39f047df2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.343751 Aug 30 14:52:58.274722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 503/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:57 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:58.478502 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:58.479211 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:58.485926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:58.487121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:58.487567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.488315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:58.488778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:58.489198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.650926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:58.662325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-51045921-0d16-4bab-b464-930b8024456c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.188101 Aug 30 14:52:58.663875 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 523/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:58 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:59.065329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:59.066222 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:59.074811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.075828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.076518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.077452 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.078597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.079306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.183783 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:59.184617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:59.194765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.195474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.196496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.197525 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.198383 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.199074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.282290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:59.290647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-deeba7e3-fc91-4f0e-841a-48c35da0f02a tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1290 microversion: 2.1 time: 0.110954 Aug 30 14:52:59.291774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 524/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:59 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1290 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:59.303948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:59.304854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:59.311546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.312347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.313510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.315111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.315735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.316360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.370867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:59.390140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ab60cacd-a16f-463b-8e48-a5656db4e388 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1690 microversion: 2.1 time: 0.329288 Aug 30 14:52:59.391420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 504/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:59 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1690 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:59.576115 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:59.595601 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a0746881-c998-429b-a4e7-4bf5a4dcbc9f tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.302502 Aug 30 14:52:59.609302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 525/1029] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:59 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:52:59.687266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:59.688115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:59.700764 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.702219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.702785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.703595 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.704236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.704993 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.982822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:52:59.994669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-630a89b8-136f-4fd6-b729-b5df06b7fe55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.312859 Aug 30 14:52:59.995658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 505/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:52:59 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:00.218432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-54082666-cd4b-4b61-a311-bcc4f1d62be8 req-c899f35d-d0a9-4119-a7b5-be015af4f393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5552e35-b056-42a7-a699-e0f24a696704", "name": "network-vif-deleted", "tag": "c2a653f7-0c72-4f59-add6-44e44654186f"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:00.242366 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-54082666-cd4b-4b61-a311-bcc4f1d62be8 req-c899f35d-d0a9-4119-a7b5-be015af4f393 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.243127 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-54082666-cd4b-4b61-a311-bcc4f1d62be8 req-c899f35d-d0a9-4119-a7b5-be015af4f393 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.243805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-54082666-cd4b-4b61-a311-bcc4f1d62be8 req-c899f35d-d0a9-4119-a7b5-be015af4f393 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.250079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:00.260826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-54082666-cd4b-4b61-a311-bcc4f1d62be8 req-c899f35d-d0a9-4119-a7b5-be015af4f393 service nova] Creating event network-vif-deleted:c2a653f7-0c72-4f59-add6-44e44654186f for instance d5552e35-b056-42a7-a699-e0f24a696704 on hv-cinder-82880 Aug 30 14:53:00.266607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-54082666-cd4b-4b61-a311-bcc4f1d62be8 req-c899f35d-d0a9-4119-a7b5-be015af4f393 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052035 Aug 30 14:53:00.267973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 526/1031] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:00.315595 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:00.317133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:00.333532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.334416 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.335016 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.335883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.336602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.337817 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.413606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:00.415681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:00.424556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.425379 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.426150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.427218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.427850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.428299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.442461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:00.462625 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4c2f87f4-8476-4aae-b721-a2b529b8c7b5 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1290 microversion: 2.1 time: 0.153134 Aug 30 14:53:00.466811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 506/1032] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:00 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1290 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:00.551182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:00.561364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-86484d18-3cf3-4218-9312-b2716f64f2cb tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1622 microversion: 2.1 time: 0.152416 Aug 30 14:53:00.561945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 527/1033] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:00 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1622 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:53:00.675100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:00.675899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:00.683533 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.684415 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.685082 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.685930 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.686417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.687032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.008860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:01.017890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c3520d67-63a6-41fb-9164-c8bb49b87a2b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1265 microversion: 2.1 time: 0.404779 Aug 30 14:53:01.018121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:01.018587 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:01.031596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 507/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:00 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:01.041324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.043319 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.043798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.044574 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.045032 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.045454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.309618 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:01.318859 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a96afd43-900f-4f83-bb70-434d83430c42 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1367 microversion: 2.1 time: 0.305185 Aug 30 14:53:01.320641 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 528/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:01 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:01.487080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:01.488596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:01.505853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.506796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.507504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.508675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.509507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.510249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.583344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:01.584393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:01.594766 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.598095 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.598674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.599677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.601305 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.601963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.637622 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.638406 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.639111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.639638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'fault' on Instance uuid d5552e35-b056-42a7-a699-e0f24a696704 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:53:01.677869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:01.688387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6864be07-66d1-41fa-ad5d-6c89c7560966 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1298 microversion: 2.1 time: 0.206124 Aug 30 14:53:01.692125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 508/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:01 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:01.705707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:01.713721 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-22cc3949-92ea-452d-88b3-12d564ebeec3 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1336 microversion: 2.1 time: 0.134722 Aug 30 14:53:01.714291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 529/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:01 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:02.039675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:02.040391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:02.046737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.047205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.047642 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.048542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.049326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.049714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.329387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:02.338105 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8b50b838-fcf5-40c5-826d-cf2a6e9ab2cf tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1451 microversion: 2.1 time: 0.302608 Aug 30 14:53:02.338845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 509/1038] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:02 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1451 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:02.340156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:02.340813 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:02.347535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.348131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.348625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.349543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.350053 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.350540 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.358664 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:02.359579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:02.366129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.366624 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.367122 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.367811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.368475 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.369081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.727206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:02.746851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-70a85600-3f03-45aa-be33-3ec59ae90424 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1451 microversion: 2.1 time: 0.384682 Aug 30 14:53:02.748286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 510/1039] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:02 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1451 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:02.753656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:02.754572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:02.761381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.762595 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.763777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.765699 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.766490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.767168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.794377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:02.810847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2a6b3e7d-4ca1-4646-addb-f2ea8d46ca55 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1557 microversion: 2.1 time: 0.474640 Aug 30 14:53:02.824044 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 530/1040] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:02 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1557 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:02.825901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:02.827801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:02.850690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.851242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.851688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.852462 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.856518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.856518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.895605 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.896213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.896846 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.897313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'fault' on Instance uuid d5552e35-b056-42a7-a699-e0f24a696704 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:53:02.902014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:02.915890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f54b6ba5-3bd3-49c3-9e33-42d2205cce8b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1296 microversion: 2.1 time: 0.166213 Aug 30 14:53:02.916763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 511/1041] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:02 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1296 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:02.937440 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:02.937939 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:02.945462 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.946256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.946988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.947865 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.948408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.949118 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.984454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:02.994145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-91a871dc-cf02-4ccb-ba78-1770544e6895 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 200 len: 1336 microversion: 2.1 time: 0.175729 Aug 30 14:53:02.994988 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 531/1042] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:02 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 1336 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:03.121292 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-082133b9-3705-4997-8a86-c02772e381cb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199028 Aug 30 14:53:03.122689 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 512/1043] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:53:02 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:03.939650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:03.940671 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:03.959872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:03.960790 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:03.960790 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:03.961328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:03.961897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:03.962202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:04.019541 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:04.020435 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: d5552e35-b056-42a7-a699-e0f24a696704] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:04.033787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:04.034531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:04.037337 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:04.039782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:04.040640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:04.041264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:04.060778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] HTTP exception thrown: Instance d5552e35-b056-42a7-a699-e0f24a696704 could not be found. Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Request method failure captured: Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 HTTP/1.1 Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJBt6DT6XPRSNgF4YQ20t2R5-A5QLe3R2nH0anCT7IqtSIz8tQpjuk4LmnHpdtyEsEO_qdxPf3NilU02EEdCojhWvVjaiNKiSaH6KqZIoN8b7AVnzUpmd46eyKonkhoItSCg-K3q20XuBM9AvACsqBJAcs13ti2fMwQYZYuvl7I5bM Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:53:04.062659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52028232fa7e4d808057e3e5512e6135", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 3398704b0dbc4af08e94b774a88851a4 Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance d5552e35-b056-42a7-a699-e0f24a696704 could not be found. Aug 30 14:53:04.064417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'd5552e35-b056-42a7-a699-e0f24a696704'} Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5552e35-b056-42a7-a699-e0f24a696704 could not be found. Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:53:04.065599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5552e35-b056-42a7-a699-e0f24a696704 could not be found. Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5552e35-b056-42a7-a699-e0f24a696704 could not be found. Aug 30 14:53:04.067206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:04.070672 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Returning 404 to user: Instance d5552e35-b056-42a7-a699-e0f24a696704 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:53:04.071871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6dfa293e-fba6-4c5e-a5c0-8b7dd19d487f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704" status: 404 len: 111 microversion: 2.1 time: 0.060635 Aug 30 14:53:04.076823 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 513/1044] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:04 2022] GET /compute/v2.1/servers/d5552e35-b056-42a7-a699-e0f24a696704 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 14:53:04.083189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0dc5847c-9180-4c1f-9c9e-bf5003c41cfe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '.version_select at 0x7fe6a9ce8d30>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:04.109984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0dc5847c-9180-4c1f-9c9e-bf5003c41cfe tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328059595" status: 202 len: 0 microversion: 2.1 time: 0.031306 Aug 30 14:53:04.114884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 514/1045] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 14:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328059595 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:53:04.392847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:04.404785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2a035f3d-dacb-42fc-a59a-75c3ef25fe39 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.469469 Aug 30 14:53:04.405930 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 532/1046] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:03 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:05.294397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-62162ec3-f510-44d9-b325-d020f57da21b req-c20fe80f-a920-4b27-8bce-487c4efdc0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f0b4a87-5efc-4610-a9a7-267fe31ce059", "tag": "66081a2c-816c-4ce3-a352-e7d4a5e250ab"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:05.306181 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:05.310764 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-62162ec3-f510-44d9-b325-d020f57da21b req-c20fe80f-a920-4b27-8bce-487c4efdc0a8 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:05.311251 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-62162ec3-f510-44d9-b325-d020f57da21b req-c20fe80f-a920-4b27-8bce-487c4efdc0a8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:05.311832 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-62162ec3-f510-44d9-b325-d020f57da21b req-c20fe80f-a920-4b27-8bce-487c4efdc0a8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:05.325401 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-62162ec3-f510-44d9-b325-d020f57da21b req-c20fe80f-a920-4b27-8bce-487c4efdc0a8 service nova] Creating event network-changed:66081a2c-816c-4ce3-a352-e7d4a5e250ab for instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 on hv-cinder-82880 Aug 30 14:53:05.331197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-62162ec3-f510-44d9-b325-d020f57da21b req-c20fe80f-a920-4b27-8bce-487c4efdc0a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041867 Aug 30 14:53:05.332312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 515/1047] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:05.427267 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:05.427893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:05.430192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:05.431135 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:05.440917 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:05.442385 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:05.443051 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:05.444090 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:05.444779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:05.445425 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:05.960282 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:05.968697 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5c5a03ee-1a55-447e-9e09-a7248938359d tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.545833 Aug 30 14:53:05.969291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 533/1048] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:05 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:05.974018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-78048713-5ce2-4da6-a5fe-5929036cc96e req-d5c5b0a9-b375-4a40-a24c-39aafec9d233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ee2335-9809-4995-a124-eb928bb62ef1", "tag": "82fccc5e-add7-4513-bcbc-d3e7fca394cc"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:06.004237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-78048713-5ce2-4da6-a5fe-5929036cc96e req-d5c5b0a9-b375-4a40-a24c-39aafec9d233 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:06.005241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-78048713-5ce2-4da6-a5fe-5929036cc96e req-d5c5b0a9-b375-4a40-a24c-39aafec9d233 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:06.005942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-78048713-5ce2-4da6-a5fe-5929036cc96e req-d5c5b0a9-b375-4a40-a24c-39aafec9d233 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:06.026189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-78048713-5ce2-4da6-a5fe-5929036cc96e req-d5c5b0a9-b375-4a40-a24c-39aafec9d233 service nova] Creating event network-changed:82fccc5e-add7-4513-bcbc-d3e7fca394cc for instance 02ee2335-9809-4995-a124-eb928bb62ef1 on hv-cinder-82880 Aug 30 14:53:06.039442 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-78048713-5ce2-4da6-a5fe-5929036cc96e req-d5c5b0a9-b375-4a40-a24c-39aafec9d233 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085393 Aug 30 14:53:06.041234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 516/1049] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:53:06.992977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:06.993652 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:07.000715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:07.001202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:07.001878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:07.002780 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:07.003226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:07.003647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:07.344118 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:07.358364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d66de89f-b39f-4349-b477-44d2e1917f97 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.369274 Aug 30 14:53:07.359807 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 534/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:06 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:07.512017 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-87365d77-c699-4c12-8039-3a2ae8d4c923 req-8ebd610f-b9dc-4430-9637-4d11d3020da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeabde5d-dfc1-47a8-a15b-47938a678196", "tag": "7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:07.523424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-87365d77-c699-4c12-8039-3a2ae8d4c923 req-8ebd610f-b9dc-4430-9637-4d11d3020da3 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:07.524153 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-87365d77-c699-4c12-8039-3a2ae8d4c923 req-8ebd610f-b9dc-4430-9637-4d11d3020da3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:07.524805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-87365d77-c699-4c12-8039-3a2ae8d4c923 req-8ebd610f-b9dc-4430-9637-4d11d3020da3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:07.536864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-87365d77-c699-4c12-8039-3a2ae8d4c923 req-8ebd610f-b9dc-4430-9637-4d11d3020da3 service nova] Creating event network-changed:7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6 for instance aeabde5d-dfc1-47a8-a15b-47938a678196 on hv-cinder-82880 Aug 30 14:53:07.542852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-87365d77-c699-4c12-8039-3a2ae8d4c923 req-8ebd610f-b9dc-4430-9637-4d11d3020da3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035585 Aug 30 14:53:07.543531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 517/1051] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:08.381041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:08.381846 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:08.395559 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:08.398350 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:08.399214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:08.401095 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:08.401735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:08.402288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:08.574084 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:08.584384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0255a757-ae1e-42e6-ace4-2606b4294ee1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.207039 Aug 30 14:53:08.590401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 535/1052] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:08 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:09.034523 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:09.035065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:09.041701 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.042179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.042606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.043300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.043755 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.044226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.071763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:53:09.146142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:09.154337 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-02f6ab75-8a9e-45e7-bf42-e80b7245589f tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 204 len: 0 microversion: 2.1 time: 0.124370 Aug 30 14:53:09.154922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 518/1053] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:53:09 2022] DELETE /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:53:09.163291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:09.163897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:09.170141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.170623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.171048 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.171734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.172280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.172666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.326344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:09.336264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2a5447e2-34f6-451b-b68c-ef84d89bba53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1507 microversion: 2.1 time: 0.176781 Aug 30 14:53:09.336840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 536/1054] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:09 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:09.611960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:09.612671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:09.621552 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.622201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.622682 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.623696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.629648 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.629991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.764875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:09.773332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dd2235fa-1c09-43e7-aba8-b03b71dc95b4 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.165684 Aug 30 14:53:09.774151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 519/1055] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:09 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:10.367709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:10.368338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:10.378812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:10.379290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:10.379717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:10.380458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:10.380902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:10.381326 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:10.745712 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:10.755427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-abb01f86-d2a1-4e24-bcb8-5930190bf12e tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1507 microversion: 2.1 time: 0.393303 Aug 30 14:53:10.756037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 537/1056] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:10 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:10.795457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:10.796100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:10.803842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:10.804305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:10.804917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:10.805679 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:10.806169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:10.806590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:10.811613 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:11.078729 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:11.088845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-809ddb53-2b6c-4bc7-98e3-3c0adb64c6dc tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.297607 Aug 30 14:53:11.089415 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 520/1057] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:10 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:11.340447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-35b82fb2-60c8-4a42-8e8e-4925a3553443 req-1513a7ee-85fb-465b-997d-5a8972ce70b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7370a3a-e107-40f2-b532-5bc089b157e8", "name": "network-vif-deleted", "tag": "0c6380b4-099c-44ab-8d72-4d08a77e7849"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:11.353665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-35b82fb2-60c8-4a42-8e8e-4925a3553443 req-1513a7ee-85fb-465b-997d-5a8972ce70b7 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:11.354570 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-35b82fb2-60c8-4a42-8e8e-4925a3553443 req-1513a7ee-85fb-465b-997d-5a8972ce70b7 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:11.355394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-35b82fb2-60c8-4a42-8e8e-4925a3553443 req-1513a7ee-85fb-465b-997d-5a8972ce70b7 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:11.367757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-35b82fb2-60c8-4a42-8e8e-4925a3553443 req-1513a7ee-85fb-465b-997d-5a8972ce70b7 service nova] Creating event network-vif-deleted:0c6380b4-099c-44ab-8d72-4d08a77e7849 for instance c7370a3a-e107-40f2-b532-5bc089b157e8 on hv-cinder-82880 Aug 30 14:53:11.373230 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-35b82fb2-60c8-4a42-8e8e-4925a3553443 req-1513a7ee-85fb-465b-997d-5a8972ce70b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036459 Aug 30 14:53:11.374105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 538/1058] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:11.777559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:11.778391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:11.785167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:11.786214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:11.786793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:11.787705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:11.788191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:11.788614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:11.824816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:11.825445 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:11.825866 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:11.826373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'fault' on Instance uuid c7370a3a-e107-40f2-b532-5bc089b157e8 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:53:11.867695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:11.875575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-87be8092-a5b4-4bc8-95e5-335831301f7c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 200 len: 1312 microversion: 2.1 time: 0.103379 Aug 30 14:53:11.876134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 521/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:11 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:12.111556 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:12.112393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:12.118919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.119338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.119847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.120817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.121435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.121944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.269230 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:12.277736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e897d30a-8f17-4f44-bf83-8ba3b59e503b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.171103 Aug 30 14:53:12.278347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 539/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:12 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:12.897751 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:12.898397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: c7370a3a-e107-40f2-b532-5bc089b157e8] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:12.905509 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.905991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.906457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.907154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.907599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.908031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.922677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] HTTP exception thrown: Instance c7370a3a-e107-40f2-b532-5bc089b157e8 could not be found. Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Request method failure captured: Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 HTTP/1.1 Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJBt6DT6XPRSNgF4YQ20t2R5-A5QLe3R2nH0anCT7IqtSIz8tQpjuk4LmnHpdtyEsEO_qdxPf3NilU02EEdCojhWvVjaiNKiSaH6KqZIoN8b7AVnzUpmd46eyKonkhoItSCg-K3q20XuBM9AvACsqBJAcs13ti2fMwQYZYuvl7I5bM Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:53:12.924421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52028232fa7e4d808057e3e5512e6135", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 3398704b0dbc4af08e94b774a88851a4 Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance c7370a3a-e107-40f2-b532-5bc089b157e8 could not be found. Aug 30 14:53:12.926027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'c7370a3a-e107-40f2-b532-5bc089b157e8'} Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7370a3a-e107-40f2-b532-5bc089b157e8 could not be found. Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:53:12.927027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7370a3a-e107-40f2-b532-5bc089b157e8 could not be found. Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7370a3a-e107-40f2-b532-5bc089b157e8 could not be found. Aug 30 14:53:12.928761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:53:12.930143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Returning 404 to user: Instance c7370a3a-e107-40f2-b532-5bc089b157e8 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:53:12.930143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f730844b-cb4d-4275-a731-e22519eb517d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8" status: 404 len: 111 microversion: 2.1 time: 0.032214 Aug 30 14:53:12.930143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 522/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:12 2022] GET /compute/v2.1/servers/c7370a3a-e107-40f2-b532-5bc089b157e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:53:12.935338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:12.935852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:12.942779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.943263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.943703 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.944435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.944885 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.945310 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.971752 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:53:13.056456 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6de062df-0b7d-47eb-9871-c1adca8a8b53 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 204 len: 0 microversion: 2.1 time: 0.124478 Aug 30 14:53:13.057002 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 540/1062] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:53:12 2022] DELETE /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:53:13.067361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:13.067975 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:13.075197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:13.075767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:13.076565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:13.077258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:13.077708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:13.078128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:13.220756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:13.229945 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6c34a867-bb74-4213-84d5-071b8a874426 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.167208 Aug 30 14:53:13.230507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 523/1063] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:13 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:13.301485 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:13.302207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:13.304586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:13.310384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:13.310798 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:13.311219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:13.311936 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:13.312414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:13.312838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:13.454345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:13.457943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:13.463144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-069ac0c8-7904-4405-b696-66214be21028 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.165964 Aug 30 14:53:13.463707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 541/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:13 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:13.960865 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-76f893c1-7f67-4f8c-ba7f-06c868769c52 req-39006e2d-5b84-477c-9c40-d349c4f4113a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ee2335-9809-4995-a124-eb928bb62ef1", "name": "network-vif-plugged", "status": "completed", "tag": "82fccc5e-add7-4513-bcbc-d3e7fca394cc"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:13.971410 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-76f893c1-7f67-4f8c-ba7f-06c868769c52 req-39006e2d-5b84-477c-9c40-d349c4f4113a service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:13.971924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-76f893c1-7f67-4f8c-ba7f-06c868769c52 req-39006e2d-5b84-477c-9c40-d349c4f4113a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:13.972415 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-76f893c1-7f67-4f8c-ba7f-06c868769c52 req-39006e2d-5b84-477c-9c40-d349c4f4113a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:13.985182 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-76f893c1-7f67-4f8c-ba7f-06c868769c52 req-39006e2d-5b84-477c-9c40-d349c4f4113a service nova] Creating event network-vif-plugged:82fccc5e-add7-4513-bcbc-d3e7fca394cc for instance 02ee2335-9809-4995-a124-eb928bb62ef1 on hv-cinder-82880 Aug 30 14:53:13.990424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-76f893c1-7f67-4f8c-ba7f-06c868769c52 req-39006e2d-5b84-477c-9c40-d349c4f4113a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034061 Aug 30 14:53:13.991254 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 524/1065] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:14.257758 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:14.258992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:14.266631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:14.267033 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:14.267454 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:14.268194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:14.268638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:14.269052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:14.485312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:14.485931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:14.495167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:14.495820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:14.496397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:14.497098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:14.497540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:14.497958 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:14.682984 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:14.691614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-29ff5da2-aeb5-46dc-beb9-bc3c577a8139 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1521 microversion: 2.1 time: 0.444292 Aug 30 14:53:14.692226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 542/1066] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:14 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:14.746657 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:14.755662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fbbf0c42-cccf-4bda-b8fd-f050f7a8a4df tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.274702 Aug 30 14:53:14.756236 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 525/1067] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:14 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:15.139418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-03aa8597-b2ff-4048-8770-3e9d1d6e4ca3 req-ab8966b1-3aeb-441d-945a-f0e5fff953d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec5ebea7-409d-4e00-9a26-030000cdb28b", "name": "network-vif-deleted", "tag": "e3436675-e20f-493c-ac9e-bc8835e548ed"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:15.149520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-03aa8597-b2ff-4048-8770-3e9d1d6e4ca3 req-ab8966b1-3aeb-441d-945a-f0e5fff953d8 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.149948 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-03aa8597-b2ff-4048-8770-3e9d1d6e4ca3 req-ab8966b1-3aeb-441d-945a-f0e5fff953d8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.150337 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-03aa8597-b2ff-4048-8770-3e9d1d6e4ca3 req-ab8966b1-3aeb-441d-945a-f0e5fff953d8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.161580 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-03aa8597-b2ff-4048-8770-3e9d1d6e4ca3 req-ab8966b1-3aeb-441d-945a-f0e5fff953d8 service nova] Creating event network-vif-deleted:e3436675-e20f-493c-ac9e-bc8835e548ed for instance ec5ebea7-409d-4e00-9a26-030000cdb28b on hv-cinder-82880 Aug 30 14:53:15.166591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-03aa8597-b2ff-4048-8770-3e9d1d6e4ca3 req-ab8966b1-3aeb-441d-945a-f0e5fff953d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031257 Aug 30 14:53:15.167186 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 543/1068] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:15.713589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:15.714133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:15.721285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.721770 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.722205 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.722892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.723343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.723762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.756671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.757157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.757586 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.758105 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'fault' on Instance uuid ec5ebea7-409d-4e00-9a26-030000cdb28b {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:53:15.777366 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:15.778099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:15.785373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.785855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.786288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.787208 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.787664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.788112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.801292 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:15.810139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1b3bddbe-3767-4dd3-a1f2-f1bb74b2f07c tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1311 microversion: 2.1 time: 0.100580 Aug 30 14:53:15.810710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 526/1069] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:15 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:15.939288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:15.947537 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0ad58044-8e4d-4655-99e0-09a990ea9fb6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1364 microversion: 2.1 time: 0.174210 Aug 30 14:53:15.948243 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 544/1070] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:15 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:16.835043 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:16.835660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:16.845221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:16.845937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:16.846542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:16.847434 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:16.848154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:16.848662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:16.882482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:16.882982 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:16.883408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:16.883842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lazy-loading 'fault' on Instance uuid ec5ebea7-409d-4e00-9a26-030000cdb28b {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:53:16.932477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3398704b0dbc4af08e94b774a88851a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52028232fa7e4d808057e3e5512e6135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:16.940629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-906fff34-533d-4bf1-93e0-53fdff7a930d tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 200 len: 1311 microversion: 2.1 time: 0.111399 Aug 30 14:53:16.941168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 527/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:16 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:16.969491 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:16.970126 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:16.978111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:16.978598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:16.979034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:16.979728 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:16.980214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:16.980639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:17.129013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:17.139063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-00a572a4-b843-4439-bbc4-3df4542a649b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1551 microversion: 2.1 time: 0.173452 Aug 30 14:53:17.139614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 545/1072] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:16 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:53:17.160211 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:17.160722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:17.167148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:17.167640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:17.168146 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:17.168849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:17.169306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:17.169736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:17.258688 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-10257ef6-0d7c-47c8-b9b2-38c4f299e73b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102375 Aug 30 14:53:17.259354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 528/1073] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:53:17 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:17.963120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:17.963849 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] [instance: ec5ebea7-409d-4e00-9a26-030000cdb28b] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:17.969901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:17.970542 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:17.971038 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:17.971714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:17.972215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:17.972629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:17.987079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] HTTP exception thrown: Instance ec5ebea7-409d-4e00-9a26-030000cdb28b could not be found. Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Request method failure captured: Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b HTTP/1.1 Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJBt6DT6XPRSNgF4YQ20t2R5-A5QLe3R2nH0anCT7IqtSIz8tQpjuk4LmnHpdtyEsEO_qdxPf3NilU02EEdCojhWvVjaiNKiSaH6KqZIoN8b7AVnzUpmd46eyKonkhoItSCg-K3q20XuBM9AvACsqBJAcs13ti2fMwQYZYuvl7I5bM Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:53:17.988788 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/52028232fa7e4d808057e3e5512e6135"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_52028232fa7e4d808057e3e5512e6135", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 52028232fa7e4d808057e3e5512e6135 Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1378624253 Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 3398704b0dbc4af08e94b774a88851a4 Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1378624253-project Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance ec5ebea7-409d-4e00-9a26-030000cdb28b could not be found. Aug 30 14:53:17.992327 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': 'ec5ebea7-409d-4e00-9a26-030000cdb28b'} Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec5ebea7-409d-4e00-9a26-030000cdb28b could not be found. Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:53:17.993391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec5ebea7-409d-4e00-9a26-030000cdb28b could not be found. Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec5ebea7-409d-4e00-9a26-030000cdb28b could not be found. Aug 30 14:53:17.994901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:53:17.996261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] Returning 404 to user: Instance ec5ebea7-409d-4e00-9a26-030000cdb28b could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:53:17.996261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f7fa9b6f-60f3-4a1b-8b6d-ed8fe6442216 tempest-ServerRescueNegativeTestJSON-1378624253 tempest-ServerRescueNegativeTestJSON-1378624253-project] 10.222.0.25 "GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b" status: 404 len: 111 microversion: 2.1 time: 0.031412 Aug 30 14:53:17.996261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 546/1074] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:53:17 2022] GET /compute/v2.1/servers/ec5ebea7-409d-4e00-9a26-030000cdb28b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:53:18.236359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-e81434be-4a05-4da4-82cb-b443b155bcdf req-61a9cf64-fc43-4272-a68a-b4d2da14a7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ee2335-9809-4995-a124-eb928bb62ef1", "tag": "82fccc5e-add7-4513-bcbc-d3e7fca394cc"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:18.246899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e81434be-4a05-4da4-82cb-b443b155bcdf req-61a9cf64-fc43-4272-a68a-b4d2da14a7e3 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:18.247774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e81434be-4a05-4da4-82cb-b443b155bcdf req-61a9cf64-fc43-4272-a68a-b4d2da14a7e3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:18.248373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-e81434be-4a05-4da4-82cb-b443b155bcdf req-61a9cf64-fc43-4272-a68a-b4d2da14a7e3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:18.261815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-e81434be-4a05-4da4-82cb-b443b155bcdf req-61a9cf64-fc43-4272-a68a-b4d2da14a7e3 service nova] Creating event network-changed:82fccc5e-add7-4513-bcbc-d3e7fca394cc for instance 02ee2335-9809-4995-a124-eb928bb62ef1 on hv-cinder-82880 Aug 30 14:53:18.267152 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-e81434be-4a05-4da4-82cb-b443b155bcdf req-61a9cf64-fc43-4272-a68a-b4d2da14a7e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035348 Aug 30 14:53:18.268286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 529/1075] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:53:42.380303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:42.380883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:42.389040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=11 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:42.389040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=22 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:42.391036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:42.391498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:42.392176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:42.392676 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:42.393124 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:42.393514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:42.419538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-253bec32-8bba-440d-a699-638159140915 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/ips" status: 200 len: 150 microversion: 2.20 time: 0.043709 Aug 30 14:53:42.420129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 547/1076] 10.222.0.25 () {60 vars in 1289 bytes} [Tue Aug 30 14:53:42 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:53:44.772024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=29 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:44.772828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=50 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:44.777162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:53:44.777782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:44.785096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:44.785576 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:44.785996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:44.786730 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:44.787199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:44.787613 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:44.813696 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lazy-loading 'flavor' on Instance uuid 96e97534-d604-4593-8ebd-af7e01f58d5a {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:53:45.018753 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6058bc73-d462-4087-829a-f1e0a75d69fc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/action" status: 202 len: 0 microversion: 2.20 time: 0.248291 Aug 30 14:53:45.019462 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 530/1077] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 14:53:44 2022] POST /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:53:45.029550 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:45.030194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:45.036946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:45.037637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:45.038230 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:45.038964 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:45.039699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:45.040539 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:45.185589 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:45.194189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:45.195614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:45.196859 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-54969e62-fca8-42e2-a9e1-c4039f1086ed tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.171254 Aug 30 14:53:45.197408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 548/1078] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:45 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:46.220187 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:46.220932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:46.228805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:46.229380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:46.229816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:46.230511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:46.231707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:46.231707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:46.381561 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:46.396646 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:46.399151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:46.401427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-debfaf0c-3793-4f5b-a2bf-08a1d0e8fe60 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.185990 Aug 30 14:53:46.402514 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 531/1079] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:46 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:47.433747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:47.435191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:47.444617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:47.445248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:47.445903 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:47.446791 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:47.447473 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:47.448064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:47.610244 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:47.619086 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:47.620529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:47.621705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a9d84e36-f8a0-42a2-8cf4-feea0d255273 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.196636 Aug 30 14:53:47.622248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 549/1080] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:47 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:48.646603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:48.647209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:48.654203 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:48.654678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:48.655109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:48.655797 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:48.656271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:48.656685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:48.800116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:48.809786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:48.811225 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:48.812447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4fcd93da-54a5-4377-9a58-b83a8127601e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.170960 Aug 30 14:53:48.813012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 532/1081] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:48 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:49.836474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:49.837107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:49.843826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:49.844337 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:49.844770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:49.845490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:49.845940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:49.846354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:49.988199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:49.998217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:49.999775 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:50.001182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8b256f12-02b4-4570-a6fd-c221cec02658 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.168812 Aug 30 14:53:50.001738 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 550/1082] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:49 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:51.024761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:51.025332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:51.032914 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:51.033418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:51.033840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:51.034541 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:51.034991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:51.035408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:51.176824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:51.187531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:51.188990 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:51.190263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a7c3da8e-cc26-4748-a904-01860ad1b0bc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.169764 Aug 30 14:53:51.191034 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 533/1083] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:51 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:52.216649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:52.217292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:52.224494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:52.224986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:52.225408 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:52.226109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:52.226558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:52.226977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:52.375661 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:52.386949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:52.389024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:52.390723 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d3a7180c-2eec-464b-8f7c-f6a439b5275f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.178853 Aug 30 14:53:52.391508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 551/1084] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:52 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:53.415480 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:53.416142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:53.422767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:53.423249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:53.423678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:53.424422 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:53.424869 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:53.425284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:53.566234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:53.577670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:53.579198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:53.580535 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-19fac1ea-4b74-4d23-8c42-7fabd9bfa898 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.169296 Aug 30 14:53:53.581115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 534/1085] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:53 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:54.611957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:54.612777 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:54.620164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:54.620658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:54.621093 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:54.621790 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:54.622236 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:54.622665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:54.760972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:54.769679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:54.771220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:54.772403 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-81d20b80-e6d1-4b25-8573-88231592e19b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.165275 Aug 30 14:53:54.772957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 552/1086] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:54 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:55.799429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:55.800307 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:55.810449 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:55.811191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:55.811858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:55.813019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:55.813452 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:55.813898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:55.951673 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:55.964064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:55.966424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:55.968286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c4e79641-8832-4cf4-a5c0-828fd1ac62d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.175114 Aug 30 14:53:55.969124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 535/1087] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:55 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:56.993800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:56.994415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:57.001043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:57.001547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:57.001973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:57.002763 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:57.003197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:57.003621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:57.193325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:57.202863 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:57.204400 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:57.205615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a1b89761-8e73-4052-81b5-ba3fd7c4799b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.215882 Aug 30 14:53:57.206138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 553/1088] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:56 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:58.229526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:58.230125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:58.236425 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:58.236915 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:58.237356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:58.238045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:58.238489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:58.238903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:58.377780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:58.386672 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:58.388134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:58.389370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4ea37b0b-416b-4fd0-b28c-7c4518a9af5b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.164498 Aug 30 14:53:58.389982 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 536/1089] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:58 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:53:59.412916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:59.414279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:59.420838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:59.421329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:59.421775 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:59.422582 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:59.422953 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:59.423362 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:59.603978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:59.613634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:59.615250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:53:59.617309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a31d9d9f-ddb3-4c07-901c-519a1181fe48 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.207936 Aug 30 14:53:59.617972 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 554/1090] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:53:59 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:00.645490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:00.646099 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:00.653297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:00.653772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:00.654195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:00.654881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:00.655321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:00.655729 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:00.815373 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:00.823979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:00.825954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:00.827046 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-070b239e-0719-4eff-b4c0-ec815ab39348 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.185971 Aug 30 14:54:00.827724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 537/1091] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:00 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:01.851562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:01.852354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:01.859800 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:01.860319 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:01.862402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:01.863168 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:01.863622 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:01.864069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:02.007874 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:02.020879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:02.023637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:02.024902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-522256f3-fd88-49e5-ac88-2e6b49413de2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1743 microversion: 2.20 time: 0.177536 Aug 30 14:54:02.025464 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 555/1092] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:01 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:03.048252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:03.048922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:03.056771 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:03.057262 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:03.057681 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:03.058399 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:03.058850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:03.059271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:03.206944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:03.216549 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:03.218003 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:03.219228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-73fc2ce8-56bb-4733-83e2-6f80fd963664 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1743 microversion: 2.20 time: 0.175169 Aug 30 14:54:03.219815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 538/1093] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:03 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:04.243334 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:04.244144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:04.251544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:04.252178 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:04.252614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:04.253595 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:04.254189 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:04.254613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:04.395699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:04.405129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:04.406555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:04.407736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-39c5d7da-7ba1-48d7-bb59-8ea25132746f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1743 microversion: 2.20 time: 0.168770 Aug 30 14:54:04.408353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 556/1094] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:04 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:05.432370 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:05.432996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:05.439604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:05.440128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:05.440561 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:05.441261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:05.441718 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:05.442134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:06.047808 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:06.056729 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:06.058153 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:06.059354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-82245506-47a9-4a2d-b23a-e35cbfb6bed4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1743 microversion: 2.20 time: 0.632106 Aug 30 14:54:06.059898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 539/1095] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:05 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1743 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:06.149302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-6b3c7a51-1979-415d-921c-b34cac21fe3a req-88defe94-dacd-457d-83ad-4035162170c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e97534-d604-4593-8ebd-af7e01f58d5a", "name": "network-vif-plugged", "status": "completed", "tag": "c0b078a2-1c95-4a1f-a09a-bc30f5710e7c"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:06.160736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-6b3c7a51-1979-415d-921c-b34cac21fe3a req-88defe94-dacd-457d-83ad-4035162170c2 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:06.161210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-6b3c7a51-1979-415d-921c-b34cac21fe3a req-88defe94-dacd-457d-83ad-4035162170c2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:06.161827 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-6b3c7a51-1979-415d-921c-b34cac21fe3a req-88defe94-dacd-457d-83ad-4035162170c2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:06.175287 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-6b3c7a51-1979-415d-921c-b34cac21fe3a req-88defe94-dacd-457d-83ad-4035162170c2 service nova] Creating event network-vif-plugged:c0b078a2-1c95-4a1f-a09a-bc30f5710e7c for instance 96e97534-d604-4593-8ebd-af7e01f58d5a on hv-cinder-82880 Aug 30 14:54:06.181792 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-6b3c7a51-1979-415d-921c-b34cac21fe3a req-88defe94-dacd-457d-83ad-4035162170c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036281 Aug 30 14:54:06.183053 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 557/1096] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:07.083255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:07.083991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:07.090656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:07.091231 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:07.091723 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:07.092542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:07.093051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:07.093540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:07.242820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:07.252750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:07.254275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:07.255698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c94efe9d-b099-4b3c-bce8-ee3aeb9cbfbf tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1743 microversion: 2.20 time: 0.177534 Aug 30 14:54:07.271544 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 540/1097] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:07 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:08.294484 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:08.295267 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:08.303662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:08.304180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:08.304617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:08.305673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:08.306288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:08.306762 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:08.591180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:08.603653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:08.605009 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:08.606176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c1503556-2c65-49b3-b8c2-9eba065c4969 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1743 microversion: 2.20 time: 0.316957 Aug 30 14:54:08.606735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 558/1098] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:08 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1743 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:09.266344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-560973019", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "networks": [{"uuid": "790cef1b-83b3-4fe3-891b-940822b11e39"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:09.322871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] validate_networks() for [('790cef1b-83b3-4fe3-891b-940822b11e39', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:54:09.631529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:09.632852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:09.642914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:09.643309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:09.643740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:09.644957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:09.645583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:09.646194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:09.781247 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:54:09.781665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:54:09.782299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:54:09.782674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:54:09.783260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:54:09.794618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:09.795371 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:09.795961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:09.796899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:09.797519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:09.798108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:09.820374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Getting quotas for project ac849c366ee54767bac65b18976c7085. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:54:09.830009 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Getting quotas for user a20233e0c38e492bad530401f388f19a and project ac849c366ee54767bac65b18976c7085. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:54:09.842141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:09.846234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:54:09.848874 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:54:09.851256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:09.852998 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:09.854430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-22c94575-e88c-4d58-ad80-69d3423ad1c5 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.228405 Aug 30 14:54:09.856156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 559/1099] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:09 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:09.903760 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-615a1b03-762f-477d-9609-029f2cddafae tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641196 Aug 30 14:54:09.910727 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 541/1100] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:54:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:54:09.915617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-88aa475a-65a1-4319-9f8e-547d8361f307 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:09.916474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-88aa475a-65a1-4319-9f8e-547d8361f307 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:09.975303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-88aa475a-65a1-4319-9f8e-547d8361f307 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:09.983019 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-88aa475a-65a1-4319-9f8e-547d8361f307 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1213 microversion: 2.1 time: 0.071278 Aug 30 14:54:09.983821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 560/1101] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:09 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:10.879515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:10.880172 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:10.886477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:10.886958 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:10.887380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:10.888195 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:10.888637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:10.889048 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:11.006600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:11.008101 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:11.015451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:11.016048 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:11.016554 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:11.017322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:11.017890 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:11.018355 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:11.039687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:11.048898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:11.050312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:11.051485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1d791aae-35d1-45e8-94c9-fa1cd791a0b7 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.176665 Aug 30 14:54:11.052059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 542/1102] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:10 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:11.093941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:11.104265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6a37a4fb-6460-40d6-836f-b3d08b955e02 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1265 microversion: 2.1 time: 0.101972 Aug 30 14:54:11.105829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 561/1103] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:11 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:12.074999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:12.076506 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:12.086879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:12.087934 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:12.088941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:12.089862 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:12.090321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:12.090746 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:12.125256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:12.125861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:12.133173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:12.134037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:12.134703 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:12.135573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:12.136290 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:12.137024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:12.416618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:12.428861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:12.446131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:12.449396 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c0b2406d-36ac-49a8-96b7-c84fbb63d9b0 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.377784 Aug 30 14:54:12.469575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 543/1104] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:12 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:12.530760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:12.535332 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=83 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:12.562646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1bf26bcc-2252-48af-8a71-0d7d84b476df tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.440973 Aug 30 14:54:12.564458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 562/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:12 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:13.479018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:13.480302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:13.486850 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-710e573b-de5a-48fb-8a1b-6da68615bead req-fed4ffac-a421-4790-ae59-f260659e1d8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7690775-8c5a-4675-8ed0-69d9991e007a", "tag": "69b55e7f-503a-4c5d-80dd-febcc8876717"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:13.489571 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.490196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.490691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.492844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.493691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.494189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.500375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=35 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:13.504794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-710e573b-de5a-48fb-8a1b-6da68615bead req-fed4ffac-a421-4790-ae59-f260659e1d8d service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.505678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-710e573b-de5a-48fb-8a1b-6da68615bead req-fed4ffac-a421-4790-ae59-f260659e1d8d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.506352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-710e573b-de5a-48fb-8a1b-6da68615bead req-fed4ffac-a421-4790-ae59-f260659e1d8d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.537969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-710e573b-de5a-48fb-8a1b-6da68615bead req-fed4ffac-a421-4790-ae59-f260659e1d8d service nova] Creating event network-changed:69b55e7f-503a-4c5d-80dd-febcc8876717 for instance c7690775-8c5a-4675-8ed0-69d9991e007a on hv-cinder-82880 Aug 30 14:54:13.545422 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-710e573b-de5a-48fb-8a1b-6da68615bead req-fed4ffac-a421-4790-ae59-f260659e1d8d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062191 Aug 30 14:54:13.546644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 563/1106] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:13.585514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:13.586781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:13.598919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.599705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.600342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.605028 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.607159 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.610717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.828440 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:13.849058 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:13.850553 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:13.851750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-97605192-caad-47ea-bc52-f363712f1454 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.379041 Aug 30 14:54:13.868973 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 544/1107] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:13 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:13.903799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:13.913375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-57ff7400-9885-45f2-a287-4ddb1e4d51d9 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.332326 Aug 30 14:54:13.914549 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 564/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:13 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:14.875675 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:14.876280 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:14.879469 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:14.885500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:14.886585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:14.887024 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:14.888041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:14.889096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:14.889995 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:14.893728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:14.935053 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:14.935770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:14.943313 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:14.944130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:14.944747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:14.945657 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:14.946300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:14.946727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:15.404450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:15.415518 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:15.417102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:15.418352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4c4fc10a-699c-4ae0-86d8-beac273636f4 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.546613 Aug 30 14:54:15.425373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:15.432081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 545/1109] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:14 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:15.436854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b5d4b42e-7071-4a07-bb6f-d5101993726f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.506142 Aug 30 14:54:15.437433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 565/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:14 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:16.458916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:16.460299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:16.468654 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:16.469413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:16.470011 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:16.471192 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:16.471819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:16.472416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:16.622995 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:16.623931 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:16.638385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:16.638874 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:16.639304 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:16.640999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:16.641513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:16.643448 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:16.713201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:16.721323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-942a18d7-1364-4bb9-9dec-4fdd33ec264d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.267489 Aug 30 14:54:16.736201 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 566/1111] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:16 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:16.821757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:16.831942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:16.833390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:16.834652 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d5821ac-acd9-4423-84e1-43c739bfd1ab tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.395278 Aug 30 14:54:16.836218 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 546/1112] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:16 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:17.746209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:17.748148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:17.759149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:17.759685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:17.760149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:17.760857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:17.761305 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:17.761725 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:17.860573 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:17.861971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:17.877348 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:17.877840 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:17.878269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:17.879178 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:17.880125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:17.880576 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:17.925384 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:17.935120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f6a04e37-6f3f-4932-937d-98f781bfd427 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.196167 Aug 30 14:54:17.949108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 567/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:17 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:18.050991 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:18.060323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:18.061792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:18.063151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b4bd934f-f369-48e4-8e70-2c94fc83c6dc tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.206484 Aug 30 14:54:18.063917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 547/1114] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:17 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:18.959283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:18.960622 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:18.968585 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:18.969072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:18.969501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:18.970914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:18.971426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:18.972060 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:19.088142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:19.089430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:19.097583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:19.098064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:19.098491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:19.099183 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:19.099847 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:19.100343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:19.123522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:19.132995 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e99197c8-3194-4dff-9c25-f5624e62e93f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.177945 Aug 30 14:54:19.134228 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 568/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:18 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:19.266256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:19.275130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:19.276948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:19.278401 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b53e9afa-5ebe-4447-971f-c947462e26c9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.195258 Aug 30 14:54:19.279480 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 548/1116] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:19 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:20.155089 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:20.155690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:20.158235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:20.163794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:20.164296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:20.164722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:20.165414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:20.165856 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:20.166269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:20.260129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-c55c66d3-e5e4-4eb5-9d3e-f18ae02fce3c req-383a0d3e-a92f-41d4-a32a-31eef1cfc344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7690775-8c5a-4675-8ed0-69d9991e007a", "name": "network-vif-plugged", "status": "completed", "tag": "69b55e7f-503a-4c5d-80dd-febcc8876717"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:20.271035 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:20.272604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=6 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:20.281845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c55c66d3-e5e4-4eb5-9d3e-f18ae02fce3c req-383a0d3e-a92f-41d4-a32a-31eef1cfc344 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:20.282621 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c55c66d3-e5e4-4eb5-9d3e-f18ae02fce3c req-383a0d3e-a92f-41d4-a32a-31eef1cfc344 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:20.283391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-c55c66d3-e5e4-4eb5-9d3e-f18ae02fce3c req-383a0d3e-a92f-41d4-a32a-31eef1cfc344 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:20.296164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-c55c66d3-e5e4-4eb5-9d3e-f18ae02fce3c req-383a0d3e-a92f-41d4-a32a-31eef1cfc344 service nova] Creating event network-vif-plugged:69b55e7f-503a-4c5d-80dd-febcc8876717 for instance c7690775-8c5a-4675-8ed0-69d9991e007a on hv-cinder-82880 Aug 30 14:54:20.301646 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-c55c66d3-e5e4-4eb5-9d3e-f18ae02fce3c req-383a0d3e-a92f-41d4-a32a-31eef1cfc344 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046154 Aug 30 14:54:20.302858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 549/1117] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:20.308616 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:20.309308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:20.310541 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:20.315522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:20.316279 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:20.316709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:20.317407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:20.317849 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:20.319238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:20.319981 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2825697c-91b8-41a3-b75c-c645d6845c7e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.168816 Aug 30 14:54:20.320898 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 569/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:20 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:20.464709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:20.473072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:20.474480 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:20.475665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f34ace8b-52f2-44f2-ab0a-421a44373bae tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1738 microversion: 2.20 time: 0.171511 Aug 30 14:54:20.476264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 550/1119] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:20 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:21.343964 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:21.344628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:21.353914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:21.354397 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:21.354829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:21.355532 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:21.355982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:21.356433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:21.499347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:21.499961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:21.506580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:21.507069 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:21.507326 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:21.507481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:21.508228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:21.508663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:21.509063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:21.517678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7db82fe9-b1b0-4d0d-9eee-c5e0efe496a0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.179471 Aug 30 14:54:21.518269 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 570/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:21 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:21.648839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:21.657411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:21.658871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:21.660045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-27704e27-12c9-43c7-9263-6aab6121560c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1720 microversion: 2.20 time: 0.164671 Aug 30 14:54:21.660615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 551/1121] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:21 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:22.539139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:22.539736 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:22.546920 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:22.547402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:22.547824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:22.548555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:22.548997 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:22.549423 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:22.683216 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:22.683473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:22.684096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:22.690649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:22.691127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:22.691553 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:22.691720 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a784cb41-003c-4f22-8171-b92bfe46dc35 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1313 microversion: 2.1 time: 0.156543 Aug 30 14:54:22.692491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:22.692648 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 571/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:22 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:22.692749 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:22.693264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:22.840844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:22.849094 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:22.850531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:22.851688 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-92d204e7-eb7b-4c8d-a18b-8643f84d8779 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1720 microversion: 2.20 time: 0.172369 Aug 30 14:54:22.852275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 552/1123] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:22 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:23.713064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:23.713631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:23.720760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:23.721238 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:23.721662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:23.722354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:23.722801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:23.723215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:23.875096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:23.879579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:23.880249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:23.883260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d9b6421c-2f57-453c-9c06-d4f92893a1fb tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1496 microversion: 2.1 time: 0.174112 Aug 30 14:54:23.884537 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 572/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:23 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1496 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:23.887623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:23.888145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:23.888583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:23.889285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:23.889763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:23.890159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:24.054707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:24.064086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:24.065540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:24.066881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6af4e8b0-4700-42fa-9315-d4932c0eecb2 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1720 microversion: 2.20 time: 0.191139 Aug 30 14:54:24.067459 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 553/1125] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:23 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:24.234447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-790a1a4f-a72a-4597-add1-f345a77ab1f0 req-ae3fd4b1-c32d-4912-86e8-b8757baad0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e97534-d604-4593-8ebd-af7e01f58d5a", "name": "network-vif-unplugged", "status": "completed", "tag": "c0b078a2-1c95-4a1f-a09a-bc30f5710e7c"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:24.244270 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-790a1a4f-a72a-4597-add1-f345a77ab1f0 req-ae3fd4b1-c32d-4912-86e8-b8757baad0f8 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:24.244742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-790a1a4f-a72a-4597-add1-f345a77ab1f0 req-ae3fd4b1-c32d-4912-86e8-b8757baad0f8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:24.245164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-790a1a4f-a72a-4597-add1-f345a77ab1f0 req-ae3fd4b1-c32d-4912-86e8-b8757baad0f8 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:24.257653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-790a1a4f-a72a-4597-add1-f345a77ab1f0 req-ae3fd4b1-c32d-4912-86e8-b8757baad0f8 service nova] Creating event network-vif-unplugged:c0b078a2-1c95-4a1f-a09a-bc30f5710e7c for instance 96e97534-d604-4593-8ebd-af7e01f58d5a on hv-cinder-82880 Aug 30 14:54:24.262990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-790a1a4f-a72a-4597-add1-f345a77ab1f0 req-ae3fd4b1-c32d-4912-86e8-b8757baad0f8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032419 Aug 30 14:54:24.263595 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 573/1126] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:24.453784 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:24.454299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:24.460786 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:24.461266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:24.461692 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:24.462367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:24.462814 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:24.463240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:24.490463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:54:24.571368 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fae91c76-a7ff-4395-ab08-13e271fab175 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 204 len: 0 microversion: 2.1 time: 0.121102 Aug 30 14:54:24.572055 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 554/1127] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:54:24 2022] DELETE /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:54:24.581412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:24.582106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:24.590164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:24.590663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:24.591096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:24.591794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:24.592287 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:24.592709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:24.734175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:24.742126 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0290ab42-b732-4499-9b01-f00c09d83118 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1502 microversion: 2.1 time: 0.165026 Aug 30 14:54:24.742683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 574/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:24 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:25.092542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:25.093189 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:25.100237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:25.100717 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:25.101135 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:25.101819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:25.102262 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:25.102674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:25.262595 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:25.275125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:25.276666 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:25.277828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a9339b83-65f7-4cf8-b45e-7b712e88edc9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1720 microversion: 2.20 time: 0.189871 Aug 30 14:54:25.278389 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 555/1129] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:25 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:25.763215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:25.763785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:25.770765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:25.771248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:25.771680 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:25.772411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:25.772860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:25.773280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:25.911035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:25.921234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3394af0e-917b-4eeb-9cf6-e1a8e2d26d3b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1502 microversion: 2.1 time: 0.162087 Aug 30 14:54:25.921849 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 575/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:25 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:26.309897 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:26.310858 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:26.317060 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:26.317536 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:26.317950 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:26.318647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:26.319088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:26.319501 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:26.493034 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:26.501914 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:26.503285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:26.504481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c605e153-3e9c-4a7a-ace4-a62c4f2d5875 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1723 microversion: 2.20 time: 0.199120 Aug 30 14:54:26.505873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 556/1131] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:26 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:26.529740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6333af04-c451-4ff5-8461-8a6917d37fd1"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:26.532594 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:26.538836 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:26.539320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:26.539750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:26.540484 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:26.540912 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:26.541325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:26.839552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0e98e629-8031-4227-a29b-9a99cbe93674 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313961 Aug 30 14:54:26.841250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 576/1132] 10.222.0.25 () {62 vars in 1364 bytes} [Tue Aug 30 14:54:26 2022] POST /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:54:26.942662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:26.943542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:26.950740 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:26.951495 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:26.952268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:26.953478 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:26.954150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:26.954724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:26.965599 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-3ab29fa2-c927-426f-b4c9-38d9c03bf96e req-e2d1d0d7-8a3d-4faa-b13a-d48300161dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7690775-8c5a-4675-8ed0-69d9991e007a", "name": "network-vif-deleted", "tag": "69b55e7f-503a-4c5d-80dd-febcc8876717"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:26.980893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-3ab29fa2-c927-426f-b4c9-38d9c03bf96e req-e2d1d0d7-8a3d-4faa-b13a-d48300161dbc service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:26.981373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-3ab29fa2-c927-426f-b4c9-38d9c03bf96e req-e2d1d0d7-8a3d-4faa-b13a-d48300161dbc service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:26.981884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-3ab29fa2-c927-426f-b4c9-38d9c03bf96e req-e2d1d0d7-8a3d-4faa-b13a-d48300161dbc service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:26.997715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-3ab29fa2-c927-426f-b4c9-38d9c03bf96e req-e2d1d0d7-8a3d-4faa-b13a-d48300161dbc service nova] Creating event network-vif-deleted:69b55e7f-503a-4c5d-80dd-febcc8876717 for instance c7690775-8c5a-4675-8ed0-69d9991e007a on hv-cinder-82880 Aug 30 14:54:27.003636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-3ab29fa2-c927-426f-b4c9-38d9c03bf96e req-e2d1d0d7-8a3d-4faa-b13a-d48300161dbc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043940 Aug 30 14:54:27.004776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 577/1133] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:27.014310 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:27.015345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:27.022804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:27.023278 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:27.023812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:27.024717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:27.025151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:27.025606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:27.030702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:27.043547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e106ff98-c7ff-4096-b369-d36e2dfaefd0 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 200 len: 1460 microversion: 2.1 time: 0.104366 Aug 30 14:54:27.053893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 557/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:26 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 1460 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:27.110392 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:27.298902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1a4fe6f0-b382-442c-862e-e23189e47314 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-volume_attachments/6333af04-c451-4ff5-8461-8a6917d37fd1" status: 202 len: 0 microversion: 2.20 time: 0.291940 Aug 30 14:54:27.299499 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 578/1135] 10.222.0.25 () {60 vars in 1457 bytes} [Tue Aug 30 14:54:27 2022] DELETE /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-volume_attachments/6333af04-c451-4ff5-8461-8a6917d37fd1 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:54:27.360936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:27.361519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:27.367955 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:27.368466 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:27.368888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:27.369559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:27.369995 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:27.370380 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:27.401057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127177) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 14:54:27.477532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d9eaa22b-7d0b-4d28-a17a-534976e14329 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "POST /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/action" status: 202 len: 0 microversion: 2.20 time: 0.120636 Aug 30 14:54:27.478903 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 558/1136] 10.222.0.25 () {62 vars in 1319 bytes} [Tue Aug 30 14:54:27 2022] POST /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:54:27.486694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:27.487306 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:27.493461 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:27.494172 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:27.494378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:27.495071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:27.495516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:27.495935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:27.654568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:27.665696 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:27.667581 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:27.669248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c268b662-14da-4189-b041-b9c7c0a36588 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1671 microversion: 2.20 time: 0.186553 Aug 30 14:54:27.670023 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 579/1137] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:27 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:28.066771 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:28.067387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: c7690775-8c5a-4675-8ed0-69d9991e007a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:28.073592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:28.074167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:28.074782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:28.075344 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:28.075788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:28.076293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:28.093240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] HTTP exception thrown: Instance c7690775-8c5a-4675-8ed0-69d9991e007a could not be found. Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Request method failure captured: Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a HTTP/1.1 Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiSP4zRXetbNRpYsCTJ3WEX9Iv-mobbv2JGPiqAdZ3etX3_i1Oyyi2KIuCdyrQiN_Rm2PFpjNXkQ_3AfC50blPvgg_w9AUUDvqRA_Er8zZ_IALNfKZM-gQU61nZ9_ErXkX0F7NXo2W8lsstS8zYDLOJcwWmp8BMDVw8sW1oS5ifKYCw Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: ac849c366ee54767bac65b18976c7085 Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesActionsTest-2050825152 Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:54:28.094933 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac849c366ee54767bac65b18976c7085"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac849c366ee54767bac65b18976c7085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac849c366ee54767bac65b18976c7085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac849c366ee54767bac65b18976c7085", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesActionsTest-2050825152 Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: ac849c366ee54767bac65b18976c7085 Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesActionsTest-2050825152 Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesActionsTest-2050825152-project Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: a20233e0c38e492bad530401f388f19a Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesActionsTest-2050825152-project Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance c7690775-8c5a-4675-8ed0-69d9991e007a could not be found. Aug 30 14:54:28.096713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'c7690775-8c5a-4675-8ed0-69d9991e007a'} Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7690775-8c5a-4675-8ed0-69d9991e007a could not be found. Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:54:28.097894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7690775-8c5a-4675-8ed0-69d9991e007a could not be found. Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7690775-8c5a-4675-8ed0-69d9991e007a could not be found. Aug 30 14:54:28.099531 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:28.100977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Returning 404 to user: Instance c7690775-8c5a-4675-8ed0-69d9991e007a could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:54:28.100977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-06f1331e-78b5-4789-a293-7549158fa095 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a" status: 404 len: 111 microversion: 2.1 time: 0.033613 Aug 30 14:54:28.100977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 559/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:28 2022] GET /compute/v2.1/servers/c7690775-8c5a-4675-8ed0-69d9991e007a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:54:28.153886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1298616583", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "networks": [{"uuid": "790cef1b-83b3-4fe3-891b-940822b11e39"}]}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:28.220092 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] validate_networks() for [('790cef1b-83b3-4fe3-891b-940822b11e39', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:54:28.605127 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:54:28.605690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:54:28.606368 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:54:28.606778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:54:28.607165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:54:28.617322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:28.617968 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:28.618512 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:28.619225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:28.619679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:28.620118 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:28.638335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Getting quotas for project ac849c366ee54767bac65b18976c7085. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:54:28.642562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Getting quotas for user a20233e0c38e492bad530401f388f19a and project ac849c366ee54767bac65b18976c7085. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:54:28.654172 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:54:28.656523 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:54:28.691941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:28.693158 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:28.700091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:28.700800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:28.701220 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:28.701906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:28.702346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:28.702728 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:28.709082 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-704cf6fa-c333-4a69-8ef4-da50b447cf3e tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560350 Aug 30 14:54:28.710978 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 580/1139] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:54:28.723876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6b742bf3-09d2-4bff-adb4-0be07afea329 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:28.724623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6b742bf3-09d2-4bff-adb4-0be07afea329 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:28.726214 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:28.801446 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6b742bf3-09d2-4bff-adb4-0be07afea329 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:28.813847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6b742bf3-09d2-4bff-adb4-0be07afea329 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1214 microversion: 2.1 time: 0.095137 Aug 30 14:54:28.820050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 581/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:28 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:28.885674 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:28.897071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:28.898655 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:28.899811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-763cbbbc-3551-4f2d-8645-e76367f9325b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1673 microversion: 2.20 time: 0.211907 Aug 30 14:54:28.900395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 560/1141] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:28 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1673 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:29.839453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:29.840920 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:29.847783 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:29.848291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:29.848746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:29.849411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:29.849852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:29.850264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:29.922148 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:29.923265 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:29.923875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:29.930542 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8ba3c0f8-2c27-495f-a5cf-70e9f5e89df5 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1266 microversion: 2.1 time: 0.097630 Aug 30 14:54:29.931120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 582/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:29 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:29.939031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:29.939031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:29.939031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:29.939031 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:29.939446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:29.939446 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:30.140777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:30.150635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:30.152542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:30.154336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-901a5b95-2db4-4856-8201-e64e3ed2a6d9 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.235141 Aug 30 14:54:30.155093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 561/1143] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:29 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:30.952439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:30.953667 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:30.971593 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:30.972106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:30.972535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:30.973250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:30.973694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:30.974109 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:31.179075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:31.179735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:31.186313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:31.187071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:31.187516 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:31.188568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:31.189026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:31.189439 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:31.214000 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:31.222786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-20b23648-d953-47a4-a51e-443bd6ed201f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.274843 Aug 30 14:54:31.223522 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 583/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:30 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:31.346614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:31.355209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:31.356713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:31.357880 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3e363460-b179-498b-bf62-67d2843c84f3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.184155 Aug 30 14:54:31.358430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 562/1145] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:31 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:32.246920 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:32.247628 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:32.254627 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:32.255107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:32.255532 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:32.256256 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:32.256704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:32.257205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:32.354100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:32.354652 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:32.361469 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:32.361946 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:32.362367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:32.363064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:32.363508 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:32.363922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:32.395396 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:32.397014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dba58987-5a15-46d0-8893-11d1c824e4e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/ips" status: 200 len: 150 microversion: 2.1 time: 0.046706 Aug 30 14:54:32.397596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 563/1146] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:54:32 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:54:32.402721 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:32.403850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:32.414209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8931e4ac-2122-40da-a441-9554c81d3aa3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.171806 Aug 30 14:54:32.414960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 584/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:32 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:32.416491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:32.417074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:32.417424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:32.418139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:32.418809 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:32.421665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:32.567430 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:32.593902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:32.595374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:32.596634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-be0baf2b-d89f-4f8c-b337-529cd1cfae64 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.198127 Aug 30 14:54:32.597193 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 564/1148] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:32 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:33.439090 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:33.439903 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:33.447361 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:33.447857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:33.448320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:33.449022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:33.449471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:33.449895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:33.595444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:33.603381 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ec3768f6-eedd-4249-b5ca-d931c8ce9f58 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.169540 Aug 30 14:54:33.603952 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 585/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:33 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:33.620610 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:33.621298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:33.628197 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:33.628918 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:33.629343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:33.630108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:33.630546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:33.631240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:33.791163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:33.800596 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:33.802424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:33.803590 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7bf11835-52cc-4e10-b2a8-8eed2d33be78 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.187189 Aug 30 14:54:33.804174 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 565/1150] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:33 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:33.829196 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab5cad79-db3a-4be8-91ba-d2323dea218b"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:33.831764 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:33.838128 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:33.838605 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:33.839030 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:33.839724 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:33.840202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:33.840616 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:34.623843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:34.625260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:34.635011 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:34.635811 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:34.636568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:34.637565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:34.638243 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:34.638963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:34.787746 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:34.795970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-237e819c-3204-4364-bab8-9a588ff4eb5f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.176034 Aug 30 14:54:34.796580 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 566/1151] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:34 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:34.830068 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:34.831213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:34.838846 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:34.839334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:34.839768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:34.840493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:34.840943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:34.841363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:34.976802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:34.985875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:34.987176 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:34.988384 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-95c85661-886b-42c4-a957-7c2d1610d42e tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.165058 Aug 30 14:54:34.989139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 567/1152] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:34 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:35.818069 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:35.819609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:35.826810 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:35.827364 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:35.827902 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:35.828778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:35.829224 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:35.829592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:35.973703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:35.982385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-ce08a29b-69c3-42bc-ae99-b986ee63f146 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.168251 Aug 30 14:54:35.982974 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 568/1153] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:35 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:36.013022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:36.013629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:36.020320 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:36.020796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:36.021222 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:36.021910 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:36.022355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:36.022767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:36.162872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:36.171629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:36.173018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:36.174191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4e972b21-bc6f-46c7-b2ab-22534d40c37c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.165143 Aug 30 14:54:36.174750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 569/1154] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:36 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:37.004796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:37.005825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:37.012741 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:37.013239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:37.013640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:37.014493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:37.015026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:37.015473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:37.157756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:37.165999 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-797b5fe2-d499-4f57-9714-79d0ed1630f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.166984 Aug 30 14:54:37.170945 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 570/1155] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:36 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:37.196887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:37.197603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:37.204219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:37.204707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:37.205138 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:37.205837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:37.206299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:37.206706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:37.361543 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:37.370877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:37.372368 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:37.373628 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9d7f36db-8418-47b2-88ef-acc6c9b6d3c3 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.180748 Aug 30 14:54:37.374725 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 571/1156] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:37 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:38.192224 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:38.192949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:38.202463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:38.202868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:38.203366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:38.204159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:38.204642 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:38.205199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:38.351133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:38.359747 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-22bb99cb-269c-4277-a93c-649b815ea77d tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.171231 Aug 30 14:54:38.360332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 572/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:38 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:38.398300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:38.399100 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:38.405210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:38.405686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:38.406110 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:38.406954 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:38.407399 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:38.407809 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:38.560522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:38.569366 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:38.570775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:38.572030 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c6d95c21-7429-48eb-ba34-e8dc1bd9b303 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.177679 Aug 30 14:54:38.572585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 573/1158] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:38 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:38.629647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:38.811169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=8 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:39.382053 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:39.382762 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:39.389482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:39.389966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:39.390395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:39.391369 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:39.391881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:39.392438 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:39.531234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:39.539059 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-35f3469d-8819-4d4f-bcb2-7c50a72a2d4f tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.160859 Aug 30 14:54:39.539862 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 574/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:39 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:39.595720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:39.596359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:39.602599 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:39.603067 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:39.603507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:39.604266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:39.604720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:39.605170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:39.745283 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:39.753944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:39.755420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:39.756805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-178d222b-520a-42dc-80b0-c0154450b6fb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.165802 Aug 30 14:54:39.757572 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 575/1160] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:39 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:40.563602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:40.564353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:40.571901 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:40.572418 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:40.572839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:40.573587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:40.574038 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:40.574464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:40.746078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:40.756096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bf953ff7-8430-49e1-8abe-b416f56588dd tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.196682 Aug 30 14:54:40.756690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 576/1161] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:40 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:40.780289 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:40.780916 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:40.787758 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:40.788256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:40.788684 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:40.789385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:40.790912 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:40.791658 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:40.810842 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:40.962730 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:40.971650 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:40.973119 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:40.974291 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2f64c2b4-0e2b-4d97-bf65-06bdc85b6d8a tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.198083 Aug 30 14:54:40.974848 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 577/1162] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:40 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:41.778257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:41.779036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:41.786433 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:41.786913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:41.787337 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:41.788089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:41.788520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:41.788937 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:41.934417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:41.942496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b6424c5b-f221-4120-8318-d593dc241316 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.168162 Aug 30 14:54:41.943104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 578/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:41 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:41.999639 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:42.000541 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:42.009932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:42.010577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:42.011123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:42.012137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:42.012827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:42.013408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:42.157511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:42.168882 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:42.170462 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:42.171659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2bcf5ebd-b9ba-42a8-bdc7-f76c1ef598e8 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.176020 Aug 30 14:54:42.172264 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 579/1164] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:41 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:42.964156 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:42.964941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:42.971864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:42.972365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:42.972766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:42.973479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:42.973915 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:42.974326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:43.111723 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:43.122306 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f29d5b8d-57ad-4c33-b921-7c004aa7af10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.161886 Aug 30 14:54:43.123108 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 580/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:42 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:43.198447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:43.199228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:43.208116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:43.208779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:43.209391 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:43.210397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:43.210875 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:43.211295 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:43.634517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:43.644346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:43.645779 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:43.646949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7b5be463-e71c-4fd4-8979-f5be58799347 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.454381 Aug 30 14:54:43.647612 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 581/1166] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:43 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:43.835834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:43.916411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:44.145535 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:44.146165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:44.153356 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:44.153832 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:44.154261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:44.154944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:44.155387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:44.155798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:44.298198 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:44.307041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3f92fe66-4d1d-48b1-ae6b-efe2bc50fa10 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.167155 Aug 30 14:54:44.307609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 582/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:44 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:44.670522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:44.671142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:44.678634 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:44.679126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:44.679564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:44.680304 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:44.680759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:44.681229 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:44.919407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:44.929246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:44.930766 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:44.931942 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-16c4be24-8eaa-4cbe-b1c0-2a30a396c415 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.265498 Aug 30 14:54:44.932818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 583/1168] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:44 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:45.043406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-4454bb7e-551c-4db7-8cbf-55bda0165bfc req-1d184f01-fcf0-478c-90b5-32a4afe7b622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "826b1e97-714e-4487-afc2-babf0d4e6d1a", "tag": "35b329ca-68b7-4acd-ad2a-4aaf46f21bde"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:45.048480 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:45.054785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4454bb7e-551c-4db7-8cbf-55bda0165bfc req-1d184f01-fcf0-478c-90b5-32a4afe7b622 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:45.055258 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4454bb7e-551c-4db7-8cbf-55bda0165bfc req-1d184f01-fcf0-478c-90b5-32a4afe7b622 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:45.055697 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-4454bb7e-551c-4db7-8cbf-55bda0165bfc req-1d184f01-fcf0-478c-90b5-32a4afe7b622 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:45.068698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-4454bb7e-551c-4db7-8cbf-55bda0165bfc req-1d184f01-fcf0-478c-90b5-32a4afe7b622 service nova] Creating event network-changed:35b329ca-68b7-4acd-ad2a-4aaf46f21bde for instance 826b1e97-714e-4487-afc2-babf0d4e6d1a on hv-cinder-82880 Aug 30 14:54:45.073957 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-4454bb7e-551c-4db7-8cbf-55bda0165bfc req-1d184f01-fcf0-478c-90b5-32a4afe7b622 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034266 Aug 30 14:54:45.074567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 584/1169] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:54:45.329557 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:45.330241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:45.337523 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:45.338002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:45.338429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:45.339149 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:45.339569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:45.339984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:45.482825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:45.491563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-dedc7960-05a2-4415-899b-47cdc396bd9c tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.166819 Aug 30 14:54:45.492148 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 585/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:45 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:45.955707 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:45.956273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:45.963206 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:45.963839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:45.964408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:45.965224 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:45.965833 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:45.966411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:46.119036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:46.127702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:46.129179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:46.130386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a9a35847-e58b-417d-90d4-b4cac7163e80 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.179298 Aug 30 14:54:46.130962 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 586/1171] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:45 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:46.512368 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:46.513103 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:46.521624 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:46.522149 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:46.522581 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:46.523320 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:46.523751 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:46.524190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:46.725048 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-63e047a4-60fa-4326-aeeb-51060f980b12 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.900005 Aug 30 14:54:46.725844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 586/1172] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:54:33 2022] POST /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 194 bytes in 12902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:54:46.763388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:46.773368 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-978f8084-170a-4001-88e7-4ce5cbbb4a39 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.264681 Aug 30 14:54:46.774702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 587/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:46 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:47.160430 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:47.161705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:47.169096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:47.169564 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:47.169992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:47.170685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:47.171127 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:47.171540 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:47.397407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:47.406591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:47.408911 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:47.410169 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-29d60144-3045-4146-ad71-9cfcf5325389 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.259053 Aug 30 14:54:47.410750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 587/1174] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:47 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:47.795750 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:47.796334 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:47.803721 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:47.804260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:47.804677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:47.805387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:47.805841 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:47.806259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:47.863528 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:47.863528 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:47.869312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:47.869789 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:47.870213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:47.871126 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:47.871754 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:47.872386 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:47.898130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-43e3a675-0a06-45ac-98e2-a5c4d54610bd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/ips" status: 200 len: 146 microversion: 2.1 time: 0.039723 Aug 30 14:54:47.898614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 588/1175] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:54:47 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:54:47.957897 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:47.965655 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7730906b-6897-45fe-afa7-a3a7e0be58a3 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.174045 Aug 30 14:54:47.966279 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 588/1176] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:47 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:48.435092 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:48.435705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:48.443343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:48.443830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:48.444299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:48.445004 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:48.445458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:48.446052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:48.596547 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:48.604979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:48.606387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:48.607540 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-48281c2a-f8b5-4a33-a6ac-d7103badaf34 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.176481 Aug 30 14:54:48.608110 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 589/1177] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:48 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:48.987545 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:48.988437 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:48.995665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:48.996234 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:48.996632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:48.997333 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:48.997785 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:48.998213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:49.138558 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:49.149920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5b40b27c-1989-4d0f-a1de-d050aab2214b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.166198 Aug 30 14:54:49.150835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 589/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:48 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:49.270487 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "287c47a3-81a4-43cc-bf30-9e64a384b1f2"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:49.274409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:49.283761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:49.284277 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:49.284711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:49.285412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:49.285858 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:49.286278 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:49.630128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:49.630743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:49.637162 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:49.637646 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:49.638072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:49.638763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:49.639242 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:49.639627 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:49.774021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:49.786615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:49.788889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:49.790520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-12e0c3da-a02b-478f-8e4f-1e3f2c57a4fd tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.164254 Aug 30 14:54:49.791132 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 590/1179] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:49 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:50.173504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:50.174362 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:50.177624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6e736693-24dc-4bbd-bb24-45520204ef05 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913609 Aug 30 14:54:50.178514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 590/1180] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:54:49 2022] POST /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:50.181489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:50.182087 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:50.182522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:50.183221 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:50.183684 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:50.184142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:50.337307 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:50.345854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5a6b7fbf-588d-4488-86f9-1671ea2f04fc tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.176167 Aug 30 14:54:50.346486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 591/1181] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:50 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:50.498301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-33c75706-9132-4848-a2ad-2530684d7f8e req-d08a15bd-a658-4551-ae83-06e175c048e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e97534-d604-4593-8ebd-af7e01f58d5a", "name": "network-vif-plugged", "status": "completed", "tag": "c0b078a2-1c95-4a1f-a09a-bc30f5710e7c"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:50.510742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-33c75706-9132-4848-a2ad-2530684d7f8e req-d08a15bd-a658-4551-ae83-06e175c048e9 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:50.511232 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-33c75706-9132-4848-a2ad-2530684d7f8e req-d08a15bd-a658-4551-ae83-06e175c048e9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:50.511786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-33c75706-9132-4848-a2ad-2530684d7f8e req-d08a15bd-a658-4551-ae83-06e175c048e9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:50.524987 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-33c75706-9132-4848-a2ad-2530684d7f8e req-d08a15bd-a658-4551-ae83-06e175c048e9 service nova] Creating event network-vif-plugged:c0b078a2-1c95-4a1f-a09a-bc30f5710e7c for instance 96e97534-d604-4593-8ebd-af7e01f58d5a on hv-cinder-82880 Aug 30 14:54:50.530685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-33c75706-9132-4848-a2ad-2530684d7f8e req-d08a15bd-a658-4551-ae83-06e175c048e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035774 Aug 30 14:54:50.531463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 591/1182] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:50.817128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:50.817735 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:50.824066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:50.824576 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:50.825006 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:50.825761 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:50.826290 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:50.826631 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:50.964066 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:50.976215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:50.978175 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:50.979822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-3d917a55-ef60-40f2-ae05-8d2648ec2cd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.167415 Aug 30 14:54:50.980603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 592/1183] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:50 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:51.372448 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:51.373329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:51.381665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:51.382143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:51.382570 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:51.383261 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:51.383705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:51.384145 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:51.530012 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:51.538471 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-19335854-b552-42f0-8389-18c8568eb21b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.172473 Aug 30 14:54:51.539049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 592/1184] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:51 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:52.005406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:52.006010 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:52.012731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:52.013201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:52.013622 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:52.014316 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:52.014757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:52.015168 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:52.156034 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:52.165240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:52.166640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:52.167828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5e1df67c-d447-4ec4-add8-1385493097be tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.166583 Aug 30 14:54:52.168408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 593/1185] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:52 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:52.547497 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-2d642783-ac0e-4763-9f92-a9260f2a18c2 req-6f727e7b-d3c1-4237-9986-b1b505600f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b1e97-714e-4487-afc2-babf0d4e6d1a", "name": "network-vif-plugged", "status": "completed", "tag": "35b329ca-68b7-4acd-ad2a-4aaf46f21bde"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:52.558654 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2d642783-ac0e-4763-9f92-a9260f2a18c2 req-6f727e7b-d3c1-4237-9986-b1b505600f41 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:52.559691 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2d642783-ac0e-4763-9f92-a9260f2a18c2 req-6f727e7b-d3c1-4237-9986-b1b505600f41 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:52.559691 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-2d642783-ac0e-4763-9f92-a9260f2a18c2 req-6f727e7b-d3c1-4237-9986-b1b505600f41 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:52.561381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:52.561985 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:52.569033 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:52.569512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:52.569944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:52.570676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:52.571113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:52.571530 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:52.571750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-2d642783-ac0e-4763-9f92-a9260f2a18c2 req-6f727e7b-d3c1-4237-9986-b1b505600f41 service nova] Creating event network-vif-plugged:35b329ca-68b7-4acd-ad2a-4aaf46f21bde for instance 826b1e97-714e-4487-afc2-babf0d4e6d1a on hv-cinder-82880 Aug 30 14:54:52.576892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-2d642783-ac0e-4763-9f92-a9260f2a18c2 req-6f727e7b-d3c1-4237-9986-b1b505600f41 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033163 Aug 30 14:54:52.577480 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 593/1186] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:52.711408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:52.713790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=100 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:52.720739 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d1ee855f-8867-4312-a6bd-41809a386600 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.163346 Aug 30 14:54:52.721327 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 594/1187] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:52 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:53.194922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:53.195615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:53.203692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:53.204209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:53.204644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:53.205391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:53.205834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:53.208889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:53.373799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:53.382755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:53.384056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:53.385252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c27c4b6c-df2d-4e1c-a5c5-c011654a9dd6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1729 microversion: 2.20 time: 0.195815 Aug 30 14:54:53.385810 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 594/1188] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:53 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:54:53.741944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:53.742533 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:53.749723 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:53.750211 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:53.750660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:53.751328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:53.751895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:53.752349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:53.918124 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:53.929776 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d5a9d7db-11a2-4283-90e3-f73019a85408 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1314 microversion: 2.1 time: 0.191634 Aug 30 14:54:53.930388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 595/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:53 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:54.409335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:54.409939 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:54.416954 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:54.417435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:54.417864 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:54.418567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:54.419009 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:54.419426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:54.604226 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:54.618752 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:54.622410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:54.624761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d15ed985-4b2b-4d9b-90ce-bc7235166b38 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1716 microversion: 2.20 time: 0.219619 Aug 30 14:54:54.639177 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 595/1190] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:54:54 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1716 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:54:54.955876 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:54.956867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:54.966260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:54.966793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:54.967228 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:54.968268 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:54.968963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:54.969608 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:55.113792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:55.122079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e750eda7-a7b9-46ee-b640-f1632c80012b tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1497 microversion: 2.1 time: 0.172412 Aug 30 14:54:55.122706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 596/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:54 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:54:55.701141 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:55.701765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:55.708699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:55.709286 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:55.709761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:55.710468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:55.710920 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:55.711424 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:55.740717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:54:55.827830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-fc7d3f71-80a8-4de3-a497-ed51835e8eb6 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "DELETE /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 204 len: 0 microversion: 2.1 time: 0.130088 Aug 30 14:54:55.828699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 596/1192] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:54:55 2022] DELETE /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:54:55.840691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:55.841482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:55.850002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:55.850453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:55.850880 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:55.851569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:55.852034 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:55.852551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:56.006325 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:56.015777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8b24c5f3-1cc3-48c6-8f9b-a583df71b8b2 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1503 microversion: 2.1 time: 0.180821 Aug 30 14:54:56.016473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 597/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:55 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:57.043044 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:57.043715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:57.051932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.052463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.052885 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.053577 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.054018 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.054420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.196885 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:57.205064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6dd5e2b8-6654-49a7-b70f-fcdca6d05395 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1503 microversion: 2.1 time: 0.166317 Aug 30 14:54:57.205696 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 597/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:57 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:57.499151 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab5cad79-db3a-4be8-91ba-d2323dea218b"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:57.502393 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:57.508985 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.509463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.509895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.510577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.511027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.511441 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.604477 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Invalid volume: volume ab5cad79-db3a-4be8-91ba-d2323dea218b is already attached to instances: 1f0b4a87-5efc-4610-a9a7-267fe31ce059 Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: POST /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments HTTP/1.1 Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 74 Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:54:57.606239 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {"volumeAttachment": {"volumeId": "ab5cad79-db3a-4be8-91ba-d2323dea218b"}} Aug 30 14:54:57.607908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Invalid volume: volume ab5cad79-db3a-4be8-91ba-d2323dea218b is already attached to instances: 1f0b4a87-5efc-4610-a9a7-267fe31ce059 Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'server_id': '1f0b4a87-5efc-4610-a9a7-267fe31ce059', 'body': {'volumeAttachment': {'volumeId': 'ab5cad79-db3a-4be8-91ba-d2323dea218b'}}} Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab5cad79-db3a-4be8-91ba-d2323dea218b is already attached to instances: 1f0b4a87-5efc-4610-a9a7-267fe31ce059 Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:57.608890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab5cad79-db3a-4be8-91ba-d2323dea218b is already attached to instances: 1f0b4a87-5efc-4610-a9a7-267fe31ce059 Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:57.610428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab5cad79-db3a-4be8-91ba-d2323dea218b is already attached to instances: 1f0b4a87-5efc-4610-a9a7-267fe31ce059 Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 400 to user: Invalid volume: volume ab5cad79-db3a-4be8-91ba-d2323dea218b is already attached to instances: 1f0b4a87-5efc-4610-a9a7-267fe31ce059 {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7d611053-7a01-46f8-9761-81ec60b0baea tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112901 Aug 30 14:54:57.612064 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 598/1195] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:54:57 2022] POST /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:54:57.675704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:57.677031 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:57.687461 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.687975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.688429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.689152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.689652 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.690572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.778929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.objects.instance [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'services' on Instance uuid 1f0b4a87-5efc-4610-a9a7-267fe31ce059 {{(pid=127176) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:54:57.859543 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5d250db6-232a-46c2-b793-798f936b7ab1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments/ab5cad79-db3a-4be8-91ba-d2323dea218b" status: 202 len: 0 microversion: 2.1 time: 0.188309 Aug 30 14:54:57.860555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 598/1196] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:54:57 2022] DELETE /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments/ab5cad79-db3a-4be8-91ba-d2323dea218b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:54:57.869074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:57.871853 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:57.881095 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.881720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.882447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.883210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:57.883915 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:57.884777 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:57.921511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e0e4631e-84d5-4ad7-bc04-d55bdb8c7487 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056425 Aug 30 14:54:57.922452 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 599/1197] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:57 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:58.210690 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-b8a70066-0b70-4bb8-9544-1ea08d05bc9d req-ad1cae41-c6f2-472d-8cca-0360c85b63f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826b1e97-714e-4487-afc2-babf0d4e6d1a", "name": "network-vif-deleted", "tag": "35b329ca-68b7-4acd-ad2a-4aaf46f21bde"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:58.226489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:58.227414 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:58.228632 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-b8a70066-0b70-4bb8-9544-1ea08d05bc9d req-ad1cae41-c6f2-472d-8cca-0360c85b63f3 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:58.229280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-b8a70066-0b70-4bb8-9544-1ea08d05bc9d req-ad1cae41-c6f2-472d-8cca-0360c85b63f3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:58.229545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-b8a70066-0b70-4bb8-9544-1ea08d05bc9d req-ad1cae41-c6f2-472d-8cca-0360c85b63f3 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:58.234569 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:58.235084 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:58.235765 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:58.236656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:58.237567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:58.238249 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:58.244263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-b8a70066-0b70-4bb8-9544-1ea08d05bc9d req-ad1cae41-c6f2-472d-8cca-0360c85b63f3 service nova] Creating event network-vif-deleted:35b329ca-68b7-4acd-ad2a-4aaf46f21bde for instance 826b1e97-714e-4487-afc2-babf0d4e6d1a on hv-cinder-82880 Aug 30 14:54:58.249155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-b8a70066-0b70-4bb8-9544-1ea08d05bc9d req-ad1cae41-c6f2-472d-8cca-0360c85b63f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045031 Aug 30 14:54:58.249838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 599/1198] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:54:58.310069 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20233e0c38e492bad530401f388f19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac849c366ee54767bac65b18976c7085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:58.318147 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-60fe1120-9178-4f83-9f97-26323e0a56f7 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 200 len: 1299 microversion: 2.1 time: 0.095505 Aug 30 14:54:58.318710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 600/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:58 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:58.936316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:58.938629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:58.945469 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:58.945943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:58.946378 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:58.947079 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:58.947533 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:58.947957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:58.974785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:58.980293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3b4650e4-9a18-410f-a454-841852aa81e3 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048506 Aug 30 14:54:58.980983 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 600/1200] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:58 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:59.339884 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:59.340512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] [instance: 826b1e97-714e-4487-afc2-babf0d4e6d1a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:59.347801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:59.348322 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:59.348778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:59.349482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:59.349967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:59.350429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:59.365407 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] HTTP exception thrown: Instance 826b1e97-714e-4487-afc2-babf0d4e6d1a could not be found. Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Request method failure captured: Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a HTTP/1.1 Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiSP4zRXetbNRpYsCTJ3WEX9Iv-mobbv2JGPiqAdZ3etX3_i1Oyyi2KIuCdyrQiN_Rm2PFpjNXkQ_3AfC50blPvgg_w9AUUDvqRA_Er8zZ_IALNfKZM-gQU61nZ9_ErXkX0F7NXo2W8lsstS8zYDLOJcwWmp8BMDVw8sW1oS5ifKYCw Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: ac849c366ee54767bac65b18976c7085 Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesActionsTest-2050825152 Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:54:59.366963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac849c366ee54767bac65b18976c7085"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ac849c366ee54767bac65b18976c7085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ac849c366ee54767bac65b18976c7085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ac849c366ee54767bac65b18976c7085", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesActionsTest-2050825152 Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: ac849c366ee54767bac65b18976c7085 Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesActionsTest-2050825152 Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesActionsTest-2050825152-project Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: a20233e0c38e492bad530401f388f19a Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesActionsTest-2050825152-project Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 826b1e97-714e-4487-afc2-babf0d4e6d1a could not be found. Aug 30 14:54:59.368667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '826b1e97-714e-4487-afc2-babf0d4e6d1a'} Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826b1e97-714e-4487-afc2-babf0d4e6d1a could not be found. Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:54:59.372288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826b1e97-714e-4487-afc2-babf0d4e6d1a could not be found. Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826b1e97-714e-4487-afc2-babf0d4e6d1a could not be found. Aug 30 14:54:59.373801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:54:59.375196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] Returning 404 to user: Instance 826b1e97-714e-4487-afc2-babf0d4e6d1a could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:54:59.375196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-751d53dc-cd41-4ca4-969a-558dd9630c31 tempest-VolumesActionsTest-2050825152 tempest-VolumesActionsTest-2050825152-project] 10.222.0.25 "GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a" status: 404 len: 111 microversion: 2.1 time: 0.032828 Aug 30 14:54:59.375196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 601/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:59 2022] GET /compute/v2.1/servers/826b1e97-714e-4487-afc2-babf0d4e6d1a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:54:59.996279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:59.999316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:00.009239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:00.009879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:00.010538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:00.011579 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:00.012239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:00.012867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:00.047638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e4ed9fe7-dd26-4b7f-810c-9e65669852bb tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057842 Aug 30 14:55:00.048218 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 601/1202] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:59 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:01.061431 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:01.063618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:01.070900 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:01.071375 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:01.071799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:01.072537 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:01.072976 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:01.073417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:01.105767 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-698b4bfb-c43a-4049-8125-30b418ca3f75 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048308 Aug 30 14:55:01.106245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 602/1203] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:01 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:02.119418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:02.122660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:02.132677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:02.133179 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:02.133745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:02.134782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:02.135239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:02.135817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:02.169483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-683d9332-8fac-416e-a853-eed360115971 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053991 Aug 30 14:55:02.170058 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 602/1204] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:02 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:03.184261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:03.187134 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:03.198982 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:03.199463 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:03.200049 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:03.200838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:03.201308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:03.201722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:03.233444 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5b0466b6-b685-4052-b1fb-7a3a787fb9be tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053884 Aug 30 14:55:03.233917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 603/1205] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:03 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:04.246933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:04.249162 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:04.256435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:04.256916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:04.257341 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:04.258032 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:04.258486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:04.258868 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:04.292538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c9de5ed7-017c-4d2a-8a3b-4ee8718e8264 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049943 Aug 30 14:55:04.293136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 603/1206] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:04 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:05.305967 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:05.308357 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:05.315514 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:05.316021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:05.316457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:05.317164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:05.317651 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:05.318072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:05.352731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2cf1288e-1f9a-4ed4-af1a-a8b2f30b35f4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051179 Aug 30 14:55:05.353328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 604/1207] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:05 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:06.317448 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:06.323328 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:06.336646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:06.338588 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:06.340075 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:06.341063 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:06.341672 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:06.342097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:06.379028 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:06.395567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:06.404782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:06.405613 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:06.406303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:06.407274 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:06.407943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:06.408618 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:06.445138 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c1fd0437-6309-4e78-91f9-9513624d8b4d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082473 Aug 30 14:55:06.447374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 605/1208] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:06 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:06.449961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2487bd17-5731-4b4d-8c96-afd87257c490 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137570 Aug 30 14:55:06.451072 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 604/1209] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:06 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:06.468977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:06.469617 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:06.486981 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:06.488655 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:06.496952 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:06.500327 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:06.503568 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:06.506881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:06.556559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-15cb1d8f-0a60-4621-989c-6fa3d84ef6da tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/287c47a3-81a4-43cc-bf30-9e64a384b1f2" status: 200 len: 194 microversion: 2.1 time: 0.096137 Aug 30 14:55:06.564139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 606/1210] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Aug 30 14:55:06 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/287c47a3-81a4-43cc-bf30-9e64a384b1f2 => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:07.474747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:07.477741 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:07.485812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:07.486314 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:07.486746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:07.487548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:07.488096 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:07.488448 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:07.524493 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-696f5294-1e60-45c3-879a-a4ec16c596d2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057268 Aug 30 14:55:07.525704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 605/1211] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:07 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:55:07.627310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:07.628831 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:07.647355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:07.648826 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:07.650183 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:07.651071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:07.651958 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:07.652547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:07.690859 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:55:07.807941 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7be2680e-8592-4aaa-b337-340b39b7688c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 204 len: 0 microversion: 2.1 time: 0.189385 Aug 30 14:55:07.814118 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 607/1212] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:55:07 2022] DELETE /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:55:07.821023 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:07.821826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:07.832263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:07.832735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:07.833199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:07.833957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:07.834621 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:07.835047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:08.094492 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:08.097179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9df1d80c-eb10-4ea4-97f1-c10c0559f210"}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:08.100774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:08.108918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-197d4a46-3544-4a5c-b3e6-c49d1dafeb85 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1682 microversion: 2.1 time: 0.292320 Aug 30 14:55:08.110160 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 606/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:07 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:08.116499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:08.117300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:08.117961 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:08.119033 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:08.119690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:08.120339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:09.133490 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:09.134459 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:09.141410 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:09.141892 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:09.142322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:09.143024 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:09.143475 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:09.143888 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:09.320332 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:09.333726 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-39dc2239-cb93-4cf0-b33f-5cb8c61ec8a2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1682 microversion: 2.1 time: 0.204247 Aug 30 14:55:09.334590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 607/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:09 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:10.361638 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:10.362407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:10.370127 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:10.370631 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:10.371207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:10.371935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:10.372420 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:10.372853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:10.537986 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:10.553710 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5bcf3f62-c566-47e4-85e7-26986decc8b6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1682 microversion: 2.1 time: 0.196109 Aug 30 14:55:10.568026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 608/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:10 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:11.584715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:11.585414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:11.592272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:11.592757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:11.593182 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:11.593879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:11.594325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:11.594742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:11.768149 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:11.783190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9226d6db-1eb4-43f2-b164-1c63350d3b19 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1682 microversion: 2.1 time: 0.204302 Aug 30 14:55:11.797293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 609/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:11 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:12.806992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:12.808656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:12.828283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:12.828989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:12.830025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:12.831139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:12.832122 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:12.832862 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:12.925532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-18a6e23d-8da7-412e-9b61-63c6ea5e0718 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "POST /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.834005 Aug 30 14:55:12.926963 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 608/1217] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:55:08 2022] POST /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments => generated 194 bytes in 4836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:13.074530 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:13.085424 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-20b3bbd0-557a-4289-a425-a71e0d8a5047 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1682 microversion: 2.1 time: 0.284074 Aug 30 14:55:13.086994 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 610/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:12 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:14.115319 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:14.117502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:14.134852 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:14.135799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:14.136424 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:14.137376 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:14.137989 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:14.138559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:14.192046 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:14.680090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:14.705663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4f166692-2d25-45e8-bc44-c4b02b94c302 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1682 microversion: 2.1 time: 0.595963 Aug 30 14:55:14.707288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 609/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:14 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1682 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:15.731219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:15.731956 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:15.737934 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:15.746826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-26728a01-d9bb-441a-84d8-5b1a92b6e037 req-3265ad70-81eb-439b-b74c-62ad8ab36336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f0b4a87-5efc-4610-a9a7-267fe31ce059", "name": "network-vif-deleted", "tag": "66081a2c-816c-4ce3-a352-e7d4a5e250ab"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:15.754709 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:15.755789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:15.757191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:15.759063 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:15.761339 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:15.761979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:15.764447 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:15.767213 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-26728a01-d9bb-441a-84d8-5b1a92b6e037 req-3265ad70-81eb-439b-b74c-62ad8ab36336 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:15.768087 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-26728a01-d9bb-441a-84d8-5b1a92b6e037 req-3265ad70-81eb-439b-b74c-62ad8ab36336 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:15.768785 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-26728a01-d9bb-441a-84d8-5b1a92b6e037 req-3265ad70-81eb-439b-b74c-62ad8ab36336 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:15.804523 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-26728a01-d9bb-441a-84d8-5b1a92b6e037 req-3265ad70-81eb-439b-b74c-62ad8ab36336 service nova] Creating event network-vif-deleted:66081a2c-816c-4ce3-a352-e7d4a5e250ab for instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 on hv-cinder-82880 Aug 30 14:55:15.815735 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-26728a01-d9bb-441a-84d8-5b1a92b6e037 req-3265ad70-81eb-439b-b74c-62ad8ab36336 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201936 Aug 30 14:55:15.821320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 611/1220] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:55:16.220377 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:16.230577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fb920d6a-25e4-44e8-a9ba-43f1b2e78e4b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 200 len: 1327 microversion: 2.1 time: 0.504925 Aug 30 14:55:16.231398 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 610/1221] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:15 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 1327 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:17.259015 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:17.260538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:17.268989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:17.269463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:17.269902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:17.270878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:17.271332 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:17.271751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:17.287181 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 HTTP/1.1 Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:55:17.289636 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:55:17.291352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '1f0b4a87-5efc-4610-a9a7-267fe31ce059'} Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:55:17.293016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:55:17.295190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:17.297090 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:55:17.297090 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3bd13546-14ae-4583-a4f6-9d64eeac70a8 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 404 len: 111 microversion: 2.1 time: 0.037051 Aug 30 14:55:17.300374 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-911d6f2a-7f85-49c4-a14e-d1f85aa6e96c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '.version_select at 0x7fe6a6376670>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:17.305647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 612/1222] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:17 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:55:17.306054 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR oslo.messaging._drivers.impl_rabbit [None req-911d6f2a-7f85-49c4-a14e-d1f85aa6e96c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [c5253383-c189-40bf-a831-c29fc2e67e31] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 14:55:18.315798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO oslo.messaging._drivers.impl_rabbit [None req-911d6f2a-7f85-49c4-a14e-d1f85aa6e96c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [c5253383-c189-40bf-a831-c29fc2e67e31] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43682. Aug 30 14:55:18.343737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-911d6f2a-7f85-49c4-a14e-d1f85aa6e96c tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012990227" status: 202 len: 0 microversion: 2.1 time: 1.047072 Aug 30 14:55:18.349861 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 611/1223] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 14:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012990227 => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 14:55:19.139613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d4bc52f6-2543-47fd-a556-fcb091b184d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: .version_select at 0x7fe6a67c3550>, body: {"keypair": {"name": "tempest-keypair-1044555018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8TI6LLqrDTL/uLDY8SEGt3OltqeR4wJaUTmR1ptvnFPLl7NN1en+AdyP2RspLmRJgZk67XyhhRULxi5qT8lsGheXpv4SrLXH0XnfOOgJ8fzxHzyRkr2bTsWU/2/xnSfg=="}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:19.156749 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-d4bc52f6-2543-47fd-a556-fcb091b184d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:55:19.161600 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-d4bc52f6-2543-47fd-a556-fcb091b184d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'key_pairs'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:55:19.188462 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d4bc52f6-2543-47fd-a556-fcb091b184d4 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052766 Aug 30 14:55:19.189188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 613/1224] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:55:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:20.291916 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2017142421", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-495216325", "security_groups": [{"name": "tempest-secgroup-smoke-1433722321"}], "block_device_mapping_v2": [{"uuid": "e8bd5a38-68b8-427d-a1df-2a5c5a0390a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "47a984e3-6912-4cff-bbe4-e504a54d421e"}]}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:20.456305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.network.neutron [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] validate_networks() for [('47a984e3-6912-4cff-bbe4-e504a54d421e', None, None, None, None, None)] {{(pid=127177) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:55:21.142964 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Flavor limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:55:21.144034 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Image limits 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:55:21.144754 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Flavor pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:55:21.145458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Image pref 0:0:0 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:55:21.145990 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.virt.hardware [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127177) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:55:21.155307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1421919252", "imageRef": "683427a6-cc9f-4d4e-809a-0771f9fe687a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f"}], "security_groups": [{"name": "tempest-securitygroup--639336144"}], "key_name": "tempest-keypair-1044555018", "user_data": "}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:21.156375 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.157156 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.157822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:21.159002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.159895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.160641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:21.184636 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:55:21.189091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Getting quotas for user 06ab23cfa18e47c9871c6f451b871ef2 and project 86111e1d9f5b485abf57231b21b3a5e9. Resources: {'cores', 'instances', 'ram'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:55:21.277042 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Going to run 1 instances... {{(pid=127177) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:55:21.283459 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8bd5a38-68b8-427d-a1df-2a5c5a0390a4',volume_size=None,volume_type=None)] {{(pid=127177) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:55:21.304305 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] validate_networks() for [('d45dd5dc-86e8-4bd7-b6eb-e1ecebbb9a0f', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:55:21.524077 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4bac63bd-f030-4bbb-bc94-0c72dbc3eeb6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.235990 Aug 30 14:55:21.531408 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 612/1225] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:55:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:55:21.551824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9ca53b40-79bb-443a-be6a-f1b50081b7da tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:21.553241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9ca53b40-79bb-443a-be6a-f1b50081b7da tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:21.695337 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9ca53b40-79bb-443a-be6a-f1b50081b7da tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:21.704421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9ca53b40-79bb-443a-be6a-f1b50081b7da tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1094 microversion: 2.1 time: 0.171572 Aug 30 14:55:21.705878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 613/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:21 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1094 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:21.784018 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:21.786302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:21.792579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.793263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.793669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:21.794384 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.794838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.795261 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:21.841883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5cd34dcd-38c7-4a08-a79f-f8569924d3f2 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060992 Aug 30 14:55:21.843426 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 614/1227] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:21 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:21.963779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:55:21.964533 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:55:21.965081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:55:21.965730 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:55:21.966138 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:55:21.977405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.980108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.980742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:21.981482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.982142 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.982720 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:21.986406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:21.987002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:21.994528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.995287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.995912 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:21.996781 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:21.997468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:21.997881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:22.000869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:55:22.006134 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Getting quotas for user f72e1a846e864aa8b00edd8ae1a948ff and project 11b0254ba7d0421e9d9214a1c400466a. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:55:22.018280 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:55:22.020870 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='683427a6-cc9f-4d4e-809a-0771f9fe687a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:55:22.029054 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-94146689-91e2-4c6a-a5cb-a8c9fb03bb4b tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/287c47a3-81a4-43cc-bf30-9e64a384b1f2" status: 200 len: 194 microversion: 2.1 time: 0.047804 Aug 30 14:55:22.029871 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 615/1228] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Aug 30 14:55:21 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/287c47a3-81a4-43cc-bf30-9e64a384b1f2 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:55:22.041326 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:22.042225 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:22.049574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:22.050398 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:22.052246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:22.053331 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:22.053790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:22.054260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:22.078222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-dafbdd26-87d1-4fa1-92c5-0aeda85b0cce tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.931683 Aug 30 14:55:22.079250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 614/1229] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:55:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:55:22.091363 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-54b1fafc-686a-4e54-add0-093e6065313f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:22.092129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-54b1fafc-686a-4e54-add0-093e6065313f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:22.155890 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-54b1fafc-686a-4e54-add0-093e6065313f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:22.158313 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lazy-loading 'services' on Instance uuid 02ee2335-9809-4995-a124-eb928bb62ef1 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:55:22.165572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-54b1fafc-686a-4e54-add0-093e6065313f tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1242 microversion: 2.1 time: 0.078953 Aug 30 14:55:22.166351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 615/1230] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:22 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:22.258316 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2edcd03c-ca77-409f-ae1b-a30111e659ac tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/287c47a3-81a4-43cc-bf30-9e64a384b1f2" status: 202 len: 0 microversion: 2.1 time: 0.222108 Aug 30 14:55:22.258904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 616/1231] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:55:22 2022] DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/287c47a3-81a4-43cc-bf30-9e64a384b1f2 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 14:55:22.731879 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:22.732407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:22.739746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:22.740374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:22.740808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:22.741496 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:22.741947 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:22.742386 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:22.816215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:22.825544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b75b8eb3-49c3-4d15-964a-dece7f389bf1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1192 microversion: 2.1 time: 0.097438 Aug 30 14:55:22.826518 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 616/1232] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:22 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:23.188822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:23.189532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:23.200585 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:23.201078 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:23.201511 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:23.202213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:23.202662 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:23.203081 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:23.269791 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:23.280406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0d6ee933-61ad-4a53-8ff8-243cfd76316e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1238 microversion: 2.1 time: 0.097182 Aug 30 14:55:23.281028 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 617/1233] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:23 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:23.858416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:23.859129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:23.868961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:23.869745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:23.870354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:23.871311 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:23.871983 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:23.872440 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:23.980133 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:23.992629 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8d83981f-2b5a-4f5e-bc32-bb2d85942157 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1210 microversion: 2.1 time: 0.141112 Aug 30 14:55:23.993215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 617/1234] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:23 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:24.307397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:24.308167 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:24.315814 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:24.316660 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:24.317351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:24.318293 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:24.319130 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:24.319802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:24.414329 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:24.425631 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7c39b1bd-7d14-4645-9d2d-f24db19f3b35 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1302 microversion: 2.1 time: 0.125688 Aug 30 14:55:24.427843 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 618/1235] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:24 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1302 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:24.494016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:24.494552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:24.501578 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:24.502453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:24.503066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:24.503895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:24.504567 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:24.505198 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:24.537295 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5782c4e1-6959-4842-9f1b-904f39fe16d3 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/9df1d80c-eb10-4ea4-97f1-c10c0559f210" status: 200 len: 194 microversion: 2.1 time: 0.049187 Aug 30 14:55:24.538658 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 618/1236] 10.222.0.25 () {58 vars in 1413 bytes} [Tue Aug 30 14:55:24 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/9df1d80c-eb10-4ea4-97f1-c10c0559f210 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:24.558949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:24.559550 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:24.566392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:24.566866 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:24.567358 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:24.568340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:24.568515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:24.569102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:24.655110 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lazy-loading 'services' on Instance uuid 02ee2335-9809-4995-a124-eb928bb62ef1 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:55:24.744534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-48c73d90-63e8-4e53-bdd3-a9a7a0271a5f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/9df1d80c-eb10-4ea4-97f1-c10c0559f210" status: 202 len: 0 microversion: 2.1 time: 0.197902 Aug 30 14:55:24.745789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 619/1237] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:55:24 2022] DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments/9df1d80c-eb10-4ea4-97f1-c10c0559f210 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:55:25.021222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:25.022200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:25.029646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:25.030129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:25.030568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:25.031388 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:25.031840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:25.032421 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:25.453800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:25.454923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:25.469225 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:25.469701 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:25.470136 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:25.470835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:25.471456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:25.472199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:25.496969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:25.505165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cf8d2ca3-1ba6-45c0-9eea-24a78d746eb4 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1278 microversion: 2.1 time: 0.490015 Aug 30 14:55:25.506413 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 619/1238] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:25 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1278 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:25.566881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:25.576800 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0f279001-a694-42e9-8289-2a5033fa12b0 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1300 microversion: 2.1 time: 0.130910 Aug 30 14:55:25.581796 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 620/1239] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:25 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:26.531918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:26.532552 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:26.539812 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:26.540292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:26.540695 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:26.541739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:26.542387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:26.542994 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:26.610074 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:26.610839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:26.617946 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:26.618559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:26.618996 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:26.619705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:26.620184 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:26.620609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.298154 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:27.313930 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cb6dc5df-2c4a-4cee-a304-4c5e9d2e608b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.785589 Aug 30 14:55:27.315326 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 620/1240] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:26 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:27.324841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:27.327508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:27.335209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.335961 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.336666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.337432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.337946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.338508 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.376717 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=100 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:27.404871 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e78f4462-94d8-4c66-aeab-3eb8e8724543 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087996 Aug 30 14:55:27.405470 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 621/1241] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:27 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:55:27.413856 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-206f390b-26a4-4a4c-bc8c-c56ba5da0bde req-5748cd03-05ed-4ce9-82ce-effd623e7490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49eaa066-a6bd-47bf-8063-4ce93ccc53d4", "tag": "e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:27.435353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-206f390b-26a4-4a4c-bc8c-c56ba5da0bde req-5748cd03-05ed-4ce9-82ce-effd623e7490 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.435842 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-206f390b-26a4-4a4c-bc8c-c56ba5da0bde req-5748cd03-05ed-4ce9-82ce-effd623e7490 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.436337 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-206f390b-26a4-4a4c-bc8c-c56ba5da0bde req-5748cd03-05ed-4ce9-82ce-effd623e7490 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.469074 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-206f390b-26a4-4a4c-bc8c-c56ba5da0bde req-5748cd03-05ed-4ce9-82ce-effd623e7490 service nova] Creating event network-changed:e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747 for instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 on hv-cinder-82880 Aug 30 14:55:27.476832 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:27.492496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-500cc8e5-7c9f-44c6-bf53-942fd0af9f6d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.889044 Aug 30 14:55:27.506519 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 621/1242] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:26 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:27.506770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-206f390b-26a4-4a4c-bc8c-c56ba5da0bde req-5748cd03-05ed-4ce9-82ce-effd623e7490 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099878 Aug 30 14:55:27.508056 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 622/1243] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:27.581637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:27.584154 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:27.592252 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.592972 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.593631 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.594345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.594795 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.595216 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.648837 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-f20ffa2d-dd8e-49e2-a3c2-417e2738581f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070926 Aug 30 14:55:27.650126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 622/1244] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:55:27 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:55:27.763992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:27.764662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:27.771859 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.772416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.772852 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.773767 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.774254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.774691 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.829700 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:55:27.968190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b1e6256f-2265-46d3-990c-c1e90152f6d0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 204 len: 0 microversion: 2.1 time: 0.208478 Aug 30 14:55:27.969440 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 623/1245] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:55:27 2022] DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:55:27.979789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:27.980965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:27.990390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.991102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.991538 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:27.992896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:27.993533 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:27.994683 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:28.156378 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:28.164746 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e7ffcb65-0387-4c04-b56e-164ec97d8e96 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1675 microversion: 2.1 time: 0.191073 Aug 30 14:55:28.166057 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 623/1246] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:27 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:28.352208 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:28.352935 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:28.361488 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:28.362361 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:28.362739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:28.365881 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:28.366799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:28.367537 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:28.522079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:28.523802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:28.536349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:28.542528 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:28.543259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:28.544730 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:28.545420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:28.546054 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:28.556329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:28.567309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-070a8501-3283-46aa-8ff1-40778864b55d tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.219054 Aug 30 14:55:28.568453 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 624/1247] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:28 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:28.719673 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:28.728186 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e3ca2fa5-d26f-448f-821d-2075450861fd tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.217826 Aug 30 14:55:28.728780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 624/1248] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:28 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:29.187561 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:29.188373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:29.195282 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:29.195760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:29.196222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:29.197173 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:29.197681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:29.198059 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:29.382617 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:29.394722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-dca3e96c-9411-4384-a0df-202e7b690c55 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1675 microversion: 2.1 time: 0.211022 Aug 30 14:55:29.396664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 625/1249] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:29 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1675 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:29.533139 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-a7201b01-191b-4cc3-bf53-bf114afb3cef req-d4ff025c-2ca1-4505-9f57-2d4a3b0cf097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964dd992-00cb-4b6c-96ad-8131be5ea962", "tag": "f86c7ddb-c260-4366-8c96-fdf3844d1abe"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:29.549736 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a7201b01-191b-4cc3-bf53-bf114afb3cef req-d4ff025c-2ca1-4505-9f57-2d4a3b0cf097 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:29.551513 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a7201b01-191b-4cc3-bf53-bf114afb3cef req-d4ff025c-2ca1-4505-9f57-2d4a3b0cf097 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:29.553561 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a7201b01-191b-4cc3-bf53-bf114afb3cef req-d4ff025c-2ca1-4505-9f57-2d4a3b0cf097 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:29.576780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-a7201b01-191b-4cc3-bf53-bf114afb3cef req-d4ff025c-2ca1-4505-9f57-2d4a3b0cf097 service nova] Creating event network-changed:f86c7ddb-c260-4366-8c96-fdf3844d1abe for instance 964dd992-00cb-4b6c-96ad-8131be5ea962 on hv-cinder-82880 Aug 30 14:55:29.584159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-a7201b01-191b-4cc3-bf53-bf114afb3cef req-d4ff025c-2ca1-4505-9f57-2d4a3b0cf097 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054569 Aug 30 14:55:29.585402 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 625/1250] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:29.588701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:29.589534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:29.601485 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:29.602817 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:29.603362 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:29.604047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:29.604486 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:29.606304 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:29.751165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:29.752716 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:29.760715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:29.761614 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:29.762269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:29.763240 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:29.763926 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:29.764620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:29.912155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:29.922360 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-61475c5b-d403-4b81-a513-91bc112effc3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.337377 Aug 30 14:55:29.923375 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 626/1251] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:29 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:29.997453 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:30.011920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-90d5d054-ae0d-464e-a291-78115c2ee3aa tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.265848 Aug 30 14:55:30.013593 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 626/1252] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:29 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:30.419546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:30.420414 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:30.428067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:30.428819 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:30.429451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:30.430235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:30.430751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:30.431239 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:30.700821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:30.712371 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4041b94d-1c25-458c-8ba9-80a5e963b8e9 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1675 microversion: 2.1 time: 0.298251 Aug 30 14:55:30.713598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 627/1253] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:30 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1675 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:30.949593 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:30.950406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:30.966087 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:30.966646 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:30.967027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:30.968016 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:30.968522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:30.969127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:31.047683 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:31.048685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:31.061979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:31.062461 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:31.062896 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:31.063605 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:31.064080 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:31.064494 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:31.171669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:31.276164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:31.295838 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:31.300392 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-02f63433-3e45-4933-a41b-2bedda849463 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.355612 Aug 30 14:55:31.305548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 627/1254] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:30 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:31.497707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:31.511491 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a5b6acf2-3560-4b47-97ff-8084af56f898 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.479215 Aug 30 14:55:31.523569 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 628/1255] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:31 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:31.735144 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:31.735984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:31.738071 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=8 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:31.746862 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:31.747352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:31.747962 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:31.748987 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:31.749436 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:31.749851 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:31.925191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:31.938040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8c99ad90-9ac2-4f82-a36f-ba6c82c071f1 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1675 microversion: 2.1 time: 0.207260 Aug 30 14:55:31.939131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 628/1256] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:31 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:32.322653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:32.324176 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:32.334265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:32.335472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=12 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:32.344977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:32.345565 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:32.346039 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:32.346918 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:32.347744 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:32.348583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:32.539250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:32.540082 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:32.561253 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:32.569386 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:32.569886 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:32.570323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:32.571038 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:32.572544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f0a301a5-da46-4b8b-8e0c-19f476ab79b6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.254769 Aug 30 14:55:32.585045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 629/1257] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:32 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:32.592601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:32.593087 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:32.608772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-9d2f3c7d-9b4d-4bc6-b0b1-486940b45f2d req-b9bf605c-fcd9-4714-831e-2536c4ec4490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ee2335-9809-4995-a124-eb928bb62ef1", "name": "network-vif-deleted", "tag": "82fccc5e-add7-4513-bcbc-d3e7fca394cc"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:32.630252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-9d2f3c7d-9b4d-4bc6-b0b1-486940b45f2d req-b9bf605c-fcd9-4714-831e-2536c4ec4490 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:32.630742 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-9d2f3c7d-9b4d-4bc6-b0b1-486940b45f2d req-b9bf605c-fcd9-4714-831e-2536c4ec4490 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:32.631288 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-9d2f3c7d-9b4d-4bc6-b0b1-486940b45f2d req-b9bf605c-fcd9-4714-831e-2536c4ec4490 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:32.652739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-9d2f3c7d-9b4d-4bc6-b0b1-486940b45f2d req-b9bf605c-fcd9-4714-831e-2536c4ec4490 service nova] Creating event network-vif-deleted:82fccc5e-add7-4513-bcbc-d3e7fca394cc for instance 02ee2335-9809-4995-a124-eb928bb62ef1 on hv-cinder-82880 Aug 30 14:55:32.659463 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-9d2f3c7d-9b4d-4bc6-b0b1-486940b45f2d req-b9bf605c-fcd9-4714-831e-2536c4ec4490 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062605 Aug 30 14:55:32.660357 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 630/1258] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:55:32.894825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:32.914149 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d20b00f9-85fb-4aeb-9437-1165d9b711a6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.374722 Aug 30 14:55:32.915574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 629/1259] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:32 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:32.965279 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:32.966343 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:32.987436 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:32.988081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:32.988734 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:32.992193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:32.993075 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:32.993808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:33.131844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:33.146933 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-26a10649-84fd-429c-9fb9-af819153d513 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1607 microversion: 2.1 time: 0.187159 Aug 30 14:55:33.149106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 631/1260] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:32 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1607 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:33.602080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:33.602807 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:33.611145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:33.621360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:33.621924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:33.622687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:33.623609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:33.624404 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:33.939845 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:33.940610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:33.954120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:33.959011 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:33.959498 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:33.960642 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:33.961993 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:33.962575 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:33.972603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:33.985403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-38810eca-c6ce-40a3-b4f5-a4d4cec879eb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.389025 Aug 30 14:55:33.986007 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 630/1261] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:33 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:34.173257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:34.174000 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:34.181900 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:34.182867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:34.183485 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:34.185792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:34.186454 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:34.187411 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:34.230634 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:34.251652 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-ff00393a-e3d1-4a1c-ad53-d0d0f0aeb6fc tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.316868 Aug 30 14:55:34.272555 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 632/1262] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:33 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:34.405534 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b3f34373414c61b94e2a8d9018cbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa5fb93320db4b1a838bed8b14ca5653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:34.422667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-115e3397-2ae8-4441-99f6-cff20d5ad9fd tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 200 len: 1607 microversion: 2.1 time: 0.253197 Aug 30 14:55:34.423575 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 631/1263] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:34 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 1607 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:35.007534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:35.008309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:35.017030 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:35.019699 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:35.020347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:35.021981 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:35.022643 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:35.023241 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:35.281669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:35.282909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:35.298096 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:35.298587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:35.299015 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:35.299733 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:35.300220 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:35.300997 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:35.668356 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:35.682869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9130194e-a6e1-4375-a179-470cf66d28c0 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.681004 Aug 30 14:55:35.686590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 633/1264] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:35 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:35.693740 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:35.694794 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:35.707139 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:35.707931 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:35.709329 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:35.710436 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:35.713049 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:35.714774 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:35.733876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] HTTP exception thrown: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Request method failure captured: Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 HTTP/1.1 Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJBJwQK1PBbBS8-P8BBVARGo6lKqSN9ie5zmHZQRsZSxDnKDIlUOom35d9E6AGDxUlG5tYi2EiSz-sdn8TK-nY4ODwkEbRchXB42GrSBS1IpNJ_HmHG4kyfvnM1dmF_3KpGCMS6vILPajQ9AUZNyXiaKBWwT4_LH4-Fhqk0RWX6ILA Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:55:35.736206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa5fb93320db4b1a838bed8b14ca5653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: a1b3f34373414c61b94e2a8d9018cbd5 Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:35.737884 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '02ee2335-9809-4995-a124-eb928bb62ef1'} Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:55:35.738867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:35.740531 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:35.743965 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Returning 404 to user: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:55:35.746349 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cd65f311-ba3e-4e41-999f-b46f3676bdf0 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 404 len: 111 microversion: 2.1 time: 0.058096 Aug 30 14:55:35.747488 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 634/1265] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:35 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:55:35.759369 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f36560e3-f8d1-4dcb-90f7-f01efcce2789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '.version_select at 0x7fe6a62aaee0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:35.812482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f36560e3-f8d1-4dcb-90f7-f01efcce2789 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395000057" status: 202 len: 0 microversion: 2.1 time: 0.060320 Aug 30 14:55:35.813778 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 635/1266] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 14:55:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395000057 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:55:35.883824 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:35.897300 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b029314a-6696-4d1f-97cd-21544b45dcdf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.619682 Aug 30 14:55:35.897888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 632/1267] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:35 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:36.707034 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:36.708013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:36.776666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:36.777190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:36.777645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:36.778385 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:36.781314 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:36.783220 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:36.919379 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:36.920720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:36.936209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:36.938308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:36.938815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:36.940826 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:36.941351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:36.945654 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:37.137615 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:37.150028 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f4cfb170-61b3-4f14-b275-b9bb1ef8d64b tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.446786 Aug 30 14:55:37.151043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 636/1268] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:36 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:37.358839 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:37.370133 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4f7242df-e548-43c5-8a7b-ff968f0c9e38 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.455036 Aug 30 14:55:37.385788 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 633/1269] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:36 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:37.954026 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-6d24f5b3-e8a4-4518-844a-4c8de002b31b req-589b3b01-c603-4b9f-a9f7-59901dbafede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964dd992-00cb-4b6c-96ad-8131be5ea962", "name": "network-vif-plugged", "status": "completed", "tag": "f86c7ddb-c260-4366-8c96-fdf3844d1abe"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:37.964144 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-6d24f5b3-e8a4-4518-844a-4c8de002b31b req-589b3b01-c603-4b9f-a9f7-59901dbafede service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:37.964619 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-6d24f5b3-e8a4-4518-844a-4c8de002b31b req-589b3b01-c603-4b9f-a9f7-59901dbafede service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:37.965041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-6d24f5b3-e8a4-4518-844a-4c8de002b31b req-589b3b01-c603-4b9f-a9f7-59901dbafede service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:37.978893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-6d24f5b3-e8a4-4518-844a-4c8de002b31b req-589b3b01-c603-4b9f-a9f7-59901dbafede service nova] Creating event network-vif-plugged:f86c7ddb-c260-4366-8c96-fdf3844d1abe for instance 964dd992-00cb-4b6c-96ad-8131be5ea962 on hv-cinder-82880 Aug 30 14:55:37.985129 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-6d24f5b3-e8a4-4518-844a-4c8de002b31b req-589b3b01-c603-4b9f-a9f7-59901dbafede service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290891 Aug 30 14:55:37.986040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 637/1270] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:55:38.189090 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:38.193125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:38.214669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:38.218686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:38.219828 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:38.223322 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:38.227671 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:38.229040 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:38.395094 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:38.396559 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:38.402999 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:38.404822 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:38.405394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:38.406625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:38.407224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:38.407878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:38.525526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:38.537986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-48c0fed9-bc2e-4ca6-986c-5c4743451fb1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.366562 Aug 30 14:55:38.541702 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 634/1271] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:38 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:38.670714 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:38.680591 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6dd29c49-3137-4230-b28a-c8ef2d38c5e2 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.290447 Aug 30 14:55:38.681748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 638/1272] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:38 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:39.359194 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:39.359751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:39.368839 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.369533 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.369967 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.371033 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.371727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.372397 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.391272 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] HTTP exception thrown: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Request method failure captured: Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 HTTP/1.1 Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJBJwQK1PBbBS8-P8BBVARGo6lKqSN9ie5zmHZQRsZSxDnKDIlUOom35d9E6AGDxUlG5tYi2EiSz-sdn8TK-nY4ODwkEbRchXB42GrSBS1IpNJ_HmHG4kyfvnM1dmF_3KpGCMS6vILPajQ9AUZNyXiaKBWwT4_LH4-Fhqk0RWX6ILA Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:55:39.395040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa5fb93320db4b1a838bed8b14ca5653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: a1b3f34373414c61b94e2a8d9018cbd5 Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.397801 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '02ee2335-9809-4995-a124-eb928bb62ef1'} Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:55:39.399260 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.404225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.408643 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Returning 404 to user: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:55:39.408643 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9aba59fb-a9d9-48fa-b4cc-9ce672f079c6 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 404 len: 111 microversion: 2.1 time: 0.048863 Aug 30 14:55:39.408643 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 639/1273] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:55:39 2022] DELETE /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:55:39.408643 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:39.408643 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: 02ee2335-9809-4995-a124-eb928bb62ef1] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:39.413315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.413809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.414251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.414926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.415372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.415829 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.434946 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] HTTP exception thrown: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Request method failure captured: Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 HTTP/1.1 Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJBJwQK1PBbBS8-P8BBVARGo6lKqSN9ie5zmHZQRsZSxDnKDIlUOom35d9E6AGDxUlG5tYi2EiSz-sdn8TK-nY4ODwkEbRchXB42GrSBS1IpNJ_HmHG4kyfvnM1dmF_3KpGCMS6vILPajQ9AUZNyXiaKBWwT4_LH4-Fhqk0RWX6ILA Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:55:39.436219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa5fb93320db4b1a838bed8b14ca5653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: a1b3f34373414c61b94e2a8d9018cbd5 Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.438867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '02ee2335-9809-4995-a124-eb928bb62ef1'} Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:55:39.440727 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. Aug 30 14:55:39.446598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:39.450359 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Returning 404 to user: Instance 02ee2335-9809-4995-a124-eb928bb62ef1 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:55:39.450359 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-61980057-1dab-468b-ad22-bb462bfbaa03 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1" status: 404 len: 111 microversion: 2.1 time: 0.035831 Aug 30 14:55:39.450359 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 640/1274] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:39 2022] GET /compute/v2.1/servers/02ee2335-9809-4995-a124-eb928bb62ef1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:55:39.548763 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b4cf8962-93c4-4294-ab05-c4815367bc65 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Action: 'create', calling method: .version_select at 0x7fe6a65145e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1532066080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlWtCkOmc8u55CQif2k3AaeuWp1b8SmSmAtNZy5QwaKE/iCa6sYImRx41pz7pmVKre/+KlNFFInu2B+CrtLj2+J5LDTH8+eAq4fMre4+LLK3y5Z3dpFedO86IWqfF1qlw=="}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:39.561803 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:39.562426 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:39.572158 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.572657 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.573097 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.573815 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.574264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.574688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.598357 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-b4cf8962-93c4-4294-ab05-c4815367bc65 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Getting quotas for project f6ce53558466411292626efed88183b0. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:55:39.602867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.quota [None req-b4cf8962-93c4-4294-ab05-c4815367bc65 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Getting quotas for user 28b133b471d64de1b9088e6ab8a4c62d and project f6ce53558466411292626efed88183b0. Resources: {'key_pairs'} {{(pid=127177) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:55:39.618417 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:39.648507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b4cf8962-93c4-4294-ab05-c4815367bc65 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.298982 Aug 30 14:55:39.649253 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 635/1275] 10.222.0.25 () {60 vars in 1159 bytes} [Tue Aug 30 14:55:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:39.706722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:39.708367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:39.721263 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.722410 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.724051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.725493 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:39.726615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:39.727491 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:39.832630 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:39.844197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-965f2683-d470-400b-b2ce-3d7436d52375 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.286094 Aug 30 14:55:39.858781 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 641/1276] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:39 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:39.999111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:40.010381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-49f85b24-43d4-4e45-8c8c-1bc5c7a9bc74 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1367 microversion: 2.1 time: 0.311514 Aug 30 14:55:40.011131 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 636/1277] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:39 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:40.633770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:40.634900 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:40.643039 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:40.643578 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:40.644130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:40.644776 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:40.645860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:40.646451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:40.666146 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] HTTP exception thrown: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Request method failure captured: Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 HTTP/1.1 Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiJBJwQK1PBbBS8-P8BBVARGo6lKqSN9ie5zmHZQRsZSxDnKDIlUOom35d9E6AGDxUlG5tYi2EiSz-sdn8TK-nY4ODwkEbRchXB42GrSBS1IpNJ_HmHG4kyfvnM1dmF_3KpGCMS6vILPajQ9AUZNyXiaKBWwT4_LH4-Fhqk0RWX6ILA Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:55:40.668021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa5fb93320db4b1a838bed8b14ca5653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: a1b3f34373414c61b94e2a8d9018cbd5 Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.669718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': 'c9e6f700-d63f-4672-80f4-1ff6f5d17c85'} Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:55:40.670653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.672167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.673681 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Returning 404 to user: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:55:40.674358 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-c24b08f0-b49b-4df7-a068-52a55599298f tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 404 len: 111 microversion: 2.1 time: 0.050287 Aug 30 14:55:40.675036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 642/1278] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:55:40 2022] DELETE /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:55:40.689974 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:40.690770 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] [instance: c9e6f700-d63f-4672-80f4-1ff6f5d17c85] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:40.698752 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:40.699403 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:40.699971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:40.700821 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:40.701383 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:40.701930 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:40.718601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] HTTP exception thrown: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Request method failure captured: Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 HTTP/1.1 Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiJBJwQK1PBbBS8-P8BBVARGo6lKqSN9ie5zmHZQRsZSxDnKDIlUOom35d9E6AGDxUlG5tYi2EiSz-sdn8TK-nY4ODwkEbRchXB42GrSBS1IpNJ_HmHG4kyfvnM1dmF_3KpGCMS6vILPajQ9AUZNyXiaKBWwT4_LH4-Fhqk0RWX6ILA Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:55:40.720922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/aa5fb93320db4b1a838bed8b14ca5653"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_aa5fb93320db4b1a838bed8b14ca5653", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: aa5fb93320db4b1a838bed8b14ca5653 Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeTestJSON-903684076 Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: a1b3f34373414c61b94e2a8d9018cbd5 Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeTestJSON-903684076-project Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.722367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'c9e6f700-d63f-4672-80f4-1ff6f5d17c85'} Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:55:40.723328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. Aug 30 14:55:40.726638 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:40.728986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] Returning 404 to user: Instance c9e6f700-d63f-4672-80f4-1ff6f5d17c85 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:55:40.742562 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6c8607cd-38c8-4aaa-bfc3-55bf2d75a125 tempest-AttachVolumeTestJSON-903684076 tempest-AttachVolumeTestJSON-903684076-project] 10.222.0.25 "GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85" status: 404 len: 111 microversion: 2.1 time: 0.062294 Aug 30 14:55:40.745504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 637/1279] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:40 2022] GET /compute/v2.1/servers/c9e6f700-d63f-4672-80f4-1ff6f5d17c85 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:55:40.888358 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:40.888977 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:40.892315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:40.902510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:40.903008 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:40.903451 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:40.904224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:40.904678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:40.905098 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:41.032237 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:41.033165 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:41.040104 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:41.040694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:41.041226 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:41.042045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:41.042948 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:41.043600 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:41.229607 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:41.243364 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-095b4cfd-4427-4fb7-bc84-54af3bae0208 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.360672 Aug 30 14:55:41.247411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 643/1280] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:40 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:41.300286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:41.319517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cfcbd57f-60bc-4220-bb7e-916a99f71120 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1558 microversion: 2.1 time: 0.292375 Aug 30 14:55:41.333179 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 638/1281] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:41 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1558 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:55:41.341085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:41.341889 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:41.348757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:41.349429 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:41.350041 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:41.350992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:41.351645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:41.352267 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:41.471604 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e3e37c0e-49de-405b-a631-841ced2f2df6 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134475 Aug 30 14:55:41.472227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 644/1282] 10.222.0.25 () {58 vars in 1275 bytes} [Tue Aug 30 14:55:41 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:41.561036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-67cd4ce6-e8e6-4da0-9514-f45ac0268cb3 req-93323504-ad9f-4cfd-ab22-0a82526deac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49eaa066-a6bd-47bf-8063-4ce93ccc53d4", "name": "network-vif-plugged", "status": "completed", "tag": "e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:41.572742 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-67cd4ce6-e8e6-4da0-9514-f45ac0268cb3 req-93323504-ad9f-4cfd-ab22-0a82526deac6 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:41.573176 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-67cd4ce6-e8e6-4da0-9514-f45ac0268cb3 req-93323504-ad9f-4cfd-ab22-0a82526deac6 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:41.579301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-67cd4ce6-e8e6-4da0-9514-f45ac0268cb3 req-93323504-ad9f-4cfd-ab22-0a82526deac6 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:41.627080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-67cd4ce6-e8e6-4da0-9514-f45ac0268cb3 req-93323504-ad9f-4cfd-ab22-0a82526deac6 service nova] Creating event network-vif-plugged:e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747 for instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 on hv-cinder-82880 Aug 30 14:55:41.633629 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-67cd4ce6-e8e6-4da0-9514-f45ac0268cb3 req-93323504-ad9f-4cfd-ab22-0a82526deac6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076445 Aug 30 14:55:41.634659 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 639/1283] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:42.270584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:42.271953 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:42.279353 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:42.280291 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:42.281394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:42.282258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:42.282897 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:42.283342 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:42.545729 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:42.560283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-188d0a34-70bf-4310-915e-f3972855bf96 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.294668 Aug 30 14:55:42.565468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 645/1284] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:42 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:43.119361 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-f64e5540-29ed-48e8-b7a7-74ef026fd00b req-25eb5b68-7b59-4945-86d7-9311a17d8a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964dd992-00cb-4b6c-96ad-8131be5ea962", "tag": "f86c7ddb-c260-4366-8c96-fdf3844d1abe"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:43.135905 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f64e5540-29ed-48e8-b7a7-74ef026fd00b req-25eb5b68-7b59-4945-86d7-9311a17d8a18 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:43.136420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f64e5540-29ed-48e8-b7a7-74ef026fd00b req-25eb5b68-7b59-4945-86d7-9311a17d8a18 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:43.136989 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-f64e5540-29ed-48e8-b7a7-74ef026fd00b req-25eb5b68-7b59-4945-86d7-9311a17d8a18 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:43.153816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-f64e5540-29ed-48e8-b7a7-74ef026fd00b req-25eb5b68-7b59-4945-86d7-9311a17d8a18 service nova] Creating event network-changed:f86c7ddb-c260-4366-8c96-fdf3844d1abe for instance 964dd992-00cb-4b6c-96ad-8131be5ea962 on hv-cinder-82880 Aug 30 14:55:43.161817 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-f64e5540-29ed-48e8-b7a7-74ef026fd00b req-25eb5b68-7b59-4945-86d7-9311a17d8a18 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047831 Aug 30 14:55:43.162998 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 640/1285] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:43.586609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:43.589585 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:43.606412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:43.616895 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:43.617787 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:43.618753 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:43.619425 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:43.620114 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:43.931481 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:43.940707 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-181fd175-7456-4f83-b0bb-56e5109d43f7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1266 microversion: 2.1 time: 0.359742 Aug 30 14:55:43.942050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 646/1286] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:43 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:44.964643 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:44.965349 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:44.982417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:44.983421 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:44.984045 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:44.985095 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:44.985698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:44.986351 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:45.237760 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:45.247850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-af16ec67-a554-457f-8594-bee84be16081 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1452 microversion: 2.1 time: 0.289024 Aug 30 14:55:45.264882 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 641/1287] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:44 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1452 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:45.270316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:45.272206 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:55:45.280796 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:45.281590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:45.282207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:45.283670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:45.284347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:45.285131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:45.464818 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:55:45.477760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a59a0c08-7581-4316-9396-bf5db0450db6 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1452 microversion: 2.1 time: 0.212678 Aug 30 14:55:45.478675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 647/1288] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:55:45 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:55:47.493423 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-464f498e-1156-4762-bfcb-443aabb441a0 tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Action: 'create', calling method: .version_select at 0x7fe6a63535e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1353498908", "metadata": {"Type": "work"}}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:47.669980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-dc08326f-4273-4ff2-a103-28fdd059e5eb req-477ae46c-be21-4c82-9595-47f5c045513b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49eaa066-a6bd-47bf-8063-4ce93ccc53d4", "tag": "e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:55:47.684050 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-dc08326f-4273-4ff2-a103-28fdd059e5eb req-477ae46c-be21-4c82-9595-47f5c045513b service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:55:47.684566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-dc08326f-4273-4ff2-a103-28fdd059e5eb req-477ae46c-be21-4c82-9595-47f5c045513b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:55:47.685175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-dc08326f-4273-4ff2-a103-28fdd059e5eb req-477ae46c-be21-4c82-9595-47f5c045513b service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:55:47.699433 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-dc08326f-4273-4ff2-a103-28fdd059e5eb req-477ae46c-be21-4c82-9595-47f5c045513b service nova] Creating event network-changed:e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747 for instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 on hv-cinder-82880 Aug 30 14:55:47.705301 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-dc08326f-4273-4ff2-a103-28fdd059e5eb req-477ae46c-be21-4c82-9595-47f5c045513b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044858 Aug 30 14:55:47.705928 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 648/1289] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:47.878050 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-464f498e-1156-4762-bfcb-443aabb441a0 tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.521769 Aug 30 14:55:47.885118 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 642/1290] 10.222.0.25 () {60 vars in 1156 bytes} [Tue Aug 30 14:55:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 523 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 14:55:47.893210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-33252d7c-91e6-4987-8423-33421f176895 tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Calling method '.version_select at 0x7fe6a627f0d0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:47.972514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-33252d7c-91e6-4987-8423-33421f176895 tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4" status: 200 len: 353 microversion: 2.1 time: 0.084136 Aug 30 14:55:47.976033 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 649/1291] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:55:47 2022] GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:48.988379 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7111577d-d6e4-4850-a2c9-c928b3ec4554 tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Calling method '.version_select at 0x7fe6a645b1f0>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:49.040163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7111577d-d6e4-4850-a2c9-c928b3ec4554 tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4" status: 200 len: 354 microversion: 2.1 time: 0.056787 Aug 30 14:55:49.040700 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 643/1292] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:55:48 2022] GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:49.054438 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b13975a4-4701-4381-a19c-516891d757df tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Calling method '.version_select at 0x7fe6a6846af0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:49.105130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b13975a4-4701-4381-a19c-516891d757df tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4" status: 200 len: 354 microversion: 2.1 time: 0.055482 Aug 30 14:55:49.105679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 650/1293] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:55:49 2022] GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:49.127350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9c4214af-d433-4dd3-b941-ead14bb0577f tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Calling method '.version_select at 0x7fe6a72a9b80>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:49.195170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9c4214af-d433-4dd3-b941-ead14bb0577f tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4" status: 202 len: 0 microversion: 2.1 time: 0.071753 Aug 30 14:55:49.195741 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 644/1294] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:55:49 2022] DELETE /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:55:49.203909 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-841c3d1c-9f05-42d4-ba32-7f9eb2c52b0c tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Calling method '.version_select at 0x7fe6a618f5e0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:49.261915 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-841c3d1c-9f05-42d4-ba32-7f9eb2c52b0c tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4" status: 200 len: 353 microversion: 2.1 time: 0.061761 Aug 30 14:55:49.262544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 651/1295] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:55:49 2022] GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:55:50.273623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:55:50.278331 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b1c484ff-f6a0-4520-8bf7-4d6ca69d9b9f tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Calling method '.version_select at 0x7fe6a64c1430>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:55:50.307970 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-b1c484ff-f6a0-4520-8bf7-4d6ca69d9b9f tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] HTTP exception thrown: Volume e52a2af4-f3ea-44c4-a32c-d218e3afade4 could not be found. Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b1c484ff-f6a0-4520-8bf7-4d6ca69d9b9f tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Request method failure captured: Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4 HTTP/1.1 Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiTzFipMVS0YrNGyh83ylwDr7mRapWZ8NnYxIPR5GfpeOPu8svmp87tBTWWs65ZLauFttu0PLdJr1MLzsBKzqewsWXCAdFGYClCKgg1OeGnCo4gFVsO_JfoPQHuqZwvCggcGB36gwxRCjPknwKk4TbDuj7U1vp5h9Q_i_kp1XTmB7nw Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: b094bc25326140a68545bb8449b53fec Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-VolumesGetTestJSON-1955144317 Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:55:50.310123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b094bc25326140a68545bb8449b53fec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b094bc25326140a68545bb8449b53fec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b094bc25326140a68545bb8449b53fec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b094bc25326140a68545bb8449b53fec", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-VolumesGetTestJSON-1955144317 Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: b094bc25326140a68545bb8449b53fec Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-VolumesGetTestJSON-1955144317 Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-VolumesGetTestJSON-1955144317-project Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 7e8ab1af104c4a67b02f000fa8912063 Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-VolumesGetTestJSON-1955144317-project Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Volume e52a2af4-f3ea-44c4-a32c-d218e3afade4 could not be found. Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'e52a2af4-f3ea-44c4-a32c-d218e3afade4'} Aug 30 14:55:50.311908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e52a2af4-f3ea-44c4-a32c-d218e3afade4 could not be found. (HTTP 404) (Request-ID: req-d716d46c-5fcb-412b-b14d-ace579159837) Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:50.312922 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:55:50.314352 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e52a2af4-f3ea-44c4-a32c-d218e3afade4 could not be found. Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 14:55:50.316816 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e52a2af4-f3ea-44c4-a32c-d218e3afade4 could not be found. Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e52a2af4-f3ea-44c4-a32c-d218e3afade4 could not be found. Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b1c484ff-f6a0-4520-8bf7-4d6ca69d9b9f tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] Returning 404 to user: Volume e52a2af4-f3ea-44c4-a32c-d218e3afade4 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b1c484ff-f6a0-4520-8bf7-4d6ca69d9b9f tempest-VolumesGetTestJSON-1955144317 tempest-VolumesGetTestJSON-1955144317-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4" status: 404 len: 109 microversion: 2.1 time: 0.038775 Aug 30 14:55:50.319330 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 645/1296] 10.222.0.25 () {58 vars in 1245 bytes} [Tue Aug 30 14:55:50 2022] GET /compute/v2.1/os-volumes/e52a2af4-f3ea-44c4-a32c-d218e3afade4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:56:05.196274 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=11 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.196987 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=34 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.200902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1828237088", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1532066080", "security_groups": [{"name": "tempest-secgroup-smoke-132439567"}], "networks": [{"uuid": "7adc7487-c523-4710-9145-1b3f955a8e93"}], "block_device_mapping_v2": [{"uuid": "70441f38-c420-4f9b-937d-3aeabc1b62bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:56:05.326445 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.network.neutron [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] validate_networks() for [('7adc7487-c523-4710-9145-1b3f955a8e93', None, None, None, None, None)] {{(pid=127176) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:56:05.734234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Flavor limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:56:05.734616 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Image limits 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:56:05.735111 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Flavor pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:56:05.735511 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Image pref 0:0:0 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:56:05.735908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.virt.hardware [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127176) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:56:05.745365 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:05.746107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:05.746534 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:05.747250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:05.747692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:05.748153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:05.765942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Getting quotas for project f6ce53558466411292626efed88183b0. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:56:05.770151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.quota [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Getting quotas for user 28b133b471d64de1b9088e6ab8a4c62d and project f6ce53558466411292626efed88183b0. Resources: {'cores', 'instances', 'ram'} {{(pid=127176) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:56:05.827655 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Going to run 1 instances... {{(pid=127176) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:56:05.830205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70441f38-c420-4f9b-937d-3aeabc1b62bd',volume_size=None,volume_type=None)] {{(pid=127176) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:56:05.972639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0f9c7a1f-85d5-414f-b00b-f3f12295b124 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.778173 Aug 30 14:56:05.978981 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 652/1297] 10.222.0.25 () {60 vars in 1147 bytes} [Tue Aug 30 14:56:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:56:05.984844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-c7b6014f-aa0e-4be5-8acf-ee14b67a165d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:05.985423 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-c7b6014f-aa0e-4be5-8acf-ee14b67a165d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:05.988292 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:05.989213 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=67 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:06.050458 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-c7b6014f-aa0e-4be5-8acf-ee14b67a165d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:06.057832 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-c7b6014f-aa0e-4be5-8acf-ee14b67a165d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1089 microversion: 2.1 time: 0.077472 Aug 30 14:56:06.058708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 646/1298] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:05 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:07.079222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:07.079841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:07.088150 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:07.088647 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:07.089191 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:07.089773 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:07.090225 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:07.090649 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:07.160069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:07.169081 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f68b9a70-72a0-489e-93fb-6c1e7b2e4a05 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1187 microversion: 2.1 time: 0.094941 Aug 30 14:56:07.169679 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 653/1299] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:07 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:08.192305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:08.192920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:08.201143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:08.201904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:08.202547 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:08.203792 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:08.204986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:08.205872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:08.369390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:08.378640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1814a4fa-4b57-4cb0-a08c-c6e3b4fac5e0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1272 microversion: 2.1 time: 0.191632 Aug 30 14:56:08.392457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 647/1300] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:08 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1272 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:09.155509 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-01fff197-5d48-4952-814f-817b2a9da366 req-48263605-adad-4c60-aabd-6243dc4599e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9070b477-3eca-4c1e-aec3-251afda78787", "tag": "15aead72-d25a-4849-9e8f-8a9c86d1544a"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:56:09.166661 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-01fff197-5d48-4952-814f-817b2a9da366 req-48263605-adad-4c60-aabd-6243dc4599e9 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:09.167619 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-01fff197-5d48-4952-814f-817b2a9da366 req-48263605-adad-4c60-aabd-6243dc4599e9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:09.168156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-01fff197-5d48-4952-814f-817b2a9da366 req-48263605-adad-4c60-aabd-6243dc4599e9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:09.183307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-01fff197-5d48-4952-814f-817b2a9da366 req-48263605-adad-4c60-aabd-6243dc4599e9 service nova] Creating event network-changed:15aead72-d25a-4849-9e8f-8a9c86d1544a for instance 9070b477-3eca-4c1e-aec3-251afda78787 on hv-cinder-82880 Aug 30 14:56:09.188974 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-01fff197-5d48-4952-814f-817b2a9da366 req-48263605-adad-4c60-aabd-6243dc4599e9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037535 Aug 30 14:56:09.189867 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 654/1301] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:56:09.403464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:09.404129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:09.414805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:09.415303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:09.415889 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:09.416656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:09.417109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:09.417527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:09.581990 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:09.591864 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-df279cc8-2667-40b4-80ac-ab35804883c2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.193683 Aug 30 14:56:09.592923 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 648/1302] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:09 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:10.615040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:10.615799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:10.622470 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:10.622959 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:10.623421 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:10.624165 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:10.624598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:10.624598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:10.767344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:10.776250 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-360c156f-279b-4c49-b436-0b04d4088adb tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.165979 Aug 30 14:56:10.776806 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 655/1303] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:10 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:11.620887 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:11.623185 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:11.630898 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.631341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.632033 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.633464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.633464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.633791 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.666969 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2d9ef154-b12a-4a1a-93c8-31280484dcb6 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050173 Aug 30 14:56:11.667540 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 649/1304] 10.222.0.25 () {60 vars in 1343 bytes} [Tue Aug 30 14:56:11 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:11.733689 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:11.734302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:11.741704 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.742188 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.742610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.743304 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.743746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.744199 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.771446 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:56:11.797022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:11.797635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:11.804475 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.804878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.805294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.805978 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.806404 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.806820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.855682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7e752fa4-20d5-4c8e-994b-4e4d2bd85229 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 204 len: 0 microversion: 2.20 time: 0.125693 Aug 30 14:56:11.859614 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 656/1305] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 14:56:11 2022] DELETE /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 14:56:11.865975 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:11.866675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:11.872799 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.873283 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.873720 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.874468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:11.874906 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:11.875302 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:11.987559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:11.995801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-4bab739b-40b7-4293-af14-9d352817ba44 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.202697 Aug 30 14:56:11.996384 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 650/1306] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:11 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:12.031687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:12.040747 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:12.042248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:12.043431 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-9bc15581-0084-4f8e-b41a-4d297728262b tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.182049 Aug 30 14:56:12.044052 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 657/1307] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:56:11 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:56:13.017276 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:13.017888 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:13.024822 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:13.025321 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:13.025721 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:13.026437 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:13.026877 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:13.027291 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:13.068164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:13.068849 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:13.076333 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:13.077093 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:13.077611 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:13.078377 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:13.078886 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:13.079361 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:13.260051 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:13.264682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:13.273698 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-836316ab-ccf6-4a8f-bec1-6fecf35f3235 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.260034 Aug 30 14:56:13.274566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:13.274803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 651/1308] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:13 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:13.276382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:13.277814 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e30087f9-aa43-4bda-8be8-9999fc3d2808 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1722 microversion: 2.20 time: 0.213944 Aug 30 14:56:13.278820 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 658/1309] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:56:13 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:56:14.309050 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:14.310168 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:14.310667 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:14.310964 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:14.317520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:14.318032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:14.318429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:14.319141 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:14.319545 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:14.319683 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:14.319989 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:14.320325 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:14.320841 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:14.321645 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:14.322200 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:14.323293 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:14.428651 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:14.444248 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:14.446000 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:14.447251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3c576b8b-0d33-4db8-8557-f681019d3b91 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1655 microversion: 2.20 time: 0.141113 Aug 30 14:56:14.447950 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 659/1310] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:56:14 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:56:14.508559 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:14.522567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-beae7704-91c1-4db9-ad64-8efbacec57e6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.217391 Aug 30 14:56:14.529673 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 652/1311] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:14 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:14.738042 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-f7ba1654-457b-40f0-b3e4-e4cb955954a5 req-bbe98c8c-f652-485d-af81-b17adcc017c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e97534-d604-4593-8ebd-af7e01f58d5a", "name": "network-vif-deleted", "tag": "c0b078a2-1c95-4a1f-a09a-bc30f5710e7c"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:56:14.749040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-f7ba1654-457b-40f0-b3e4-e4cb955954a5 req-bbe98c8c-f652-485d-af81-b17adcc017c2 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:14.749515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-f7ba1654-457b-40f0-b3e4-e4cb955954a5 req-bbe98c8c-f652-485d-af81-b17adcc017c2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:14.749940 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-f7ba1654-457b-40f0-b3e4-e4cb955954a5 req-bbe98c8c-f652-485d-af81-b17adcc017c2 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:14.766190 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-f7ba1654-457b-40f0-b3e4-e4cb955954a5 req-bbe98c8c-f652-485d-af81-b17adcc017c2 service nova] Creating event network-vif-deleted:c0b078a2-1c95-4a1f-a09a-bc30f5710e7c for instance 96e97534-d604-4593-8ebd-af7e01f58d5a on hv-cinder-82880 Aug 30 14:56:14.771960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-f7ba1654-457b-40f0-b3e4-e4cb955954a5 req-bbe98c8c-f652-485d-af81-b17adcc017c2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038171 Aug 30 14:56:14.773224 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 660/1312] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:56:15.476322 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:15.477958 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:15.491699 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:15.492753 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:15.493364 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:15.494606 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:15.495420 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:15.497062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:15.547107 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:15.549556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:15.550388 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:15.550979 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:15.551944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lazy-loading 'fault' on Instance uuid 96e97534-d604-4593-8ebd-af7e01f58d5a {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:56:15.552152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:15.562719 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:15.563688 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:15.564673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:15.565804 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:15.567687 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:15.570650 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:15.619073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:15.633710 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:15.635089 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '521cc5ea8fb045bc81e8e3bfa8ba239b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21f6e5be24e448f9b981ad77d23de8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:15.636879 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d0a1971b-6318-49eb-84a8-c1d2ab63169f tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 200 len: 1372 microversion: 2.20 time: 0.169970 Aug 30 14:56:15.638988 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 653/1313] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:56:15 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:56:15.758847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:15.765945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:15.776466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5f9e8711-a60a-445c-b20d-f95b3950d915 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.231239 Aug 30 14:56:15.784267 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 661/1314] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:15 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:16.662288 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:16.662908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:16.665633 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell0:SELECT=2 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:16.671774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:16.672318 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:16.672743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:16.673713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:16.673881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:16.674294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:16.689135 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] HTTP exception thrown: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Request method failure captured: Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a HTTP/1.1 Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiI-PxYP8QyaTIsRZGl8lYFVmVxS9kVkdh8QKkJRBXrmhdy7ZlMsHIIE4lWMJe99jpr19YL3cuNjicjOs3SQ43Sdrkh0wZIRKK0GM2dWDc6R9hrJFV1RvHOvuAg_K6crZylQrvdbn3UyT79U9FrwYpzW-qovgdXkJnsB_EUgv3PRWU4 Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:56:16.690705 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21f6e5be24e448f9b981ad77d23de8bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 521cc5ea8fb045bc81e8e3bfa8ba239b Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:16.692663 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '96e97534-d604-4593-8ebd-af7e01f58d5a'} Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:56:16.693924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:16.695294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:16.697632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Returning 404 to user: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:56:16.697632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-752cd352-f0d1-4658-ae1d-d28ee391c144 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 404 len: 111 microversion: 2.20 time: 0.033923 Aug 30 14:56:16.697632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 654/1315] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:56:16 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:56:16.701821 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-2af696dd-3488-4dfc-b9aa-ddaef5ef7a0c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '.version_select at 0x7fe6a61d1700>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:16.709857 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell0:SELECT=6 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:16.724085 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-2af696dd-3488-4dfc-b9aa-ddaef5ef7a0c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610858743" status: 204 len: 0 microversion: 2.20 time: 0.026016 Aug 30 14:56:16.724955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 662/1316] 10.222.0.25 () {60 vars in 1262 bytes} [Tue Aug 30 14:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610858743 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 14:56:16.797482 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:16.798011 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:16.805895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:16.806384 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:16.806854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:16.807669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:16.808537 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:16.809116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:16.971065 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:16.979318 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-40a9d82d-63ef-448a-a06b-a4b89f548928 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.185805 Aug 30 14:56:16.979881 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 655/1317] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:16 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:18.000755 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:18.001474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:18.009303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:18.009861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:18.010354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:18.011107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:18.011652 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:18.012105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:18.160598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:18.168197 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0c707fab-692b-424e-ba3d-405227fd9d5c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.171982 Aug 30 14:56:18.168770 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 663/1318] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:17 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:18.567790 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:18.568406 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:18.574820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:18.575299 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:18.575726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:18.576452 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:18.576891 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:18.577311 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:18.593140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] HTTP exception thrown: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Request method failure captured: Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: DELETE /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a HTTP/1.1 Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiI-PxYP8QyaTIsRZGl8lYFVmVxS9kVkdh8QKkJRBXrmhdy7ZlMsHIIE4lWMJe99jpr19YL3cuNjicjOs3SQ43Sdrkh0wZIRKK0GM2dWDc6R9hrJFV1RvHOvuAg_K6crZylQrvdbn3UyT79U9FrwYpzW-qovgdXkJnsB_EUgv3PRWU4 Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:56:18.594782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21f6e5be24e448f9b981ad77d23de8bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 521cc5ea8fb045bc81e8e3bfa8ba239b Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.596570 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '96e97534-d604-4593-8ebd-af7e01f58d5a'} Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:56:18.597551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.598994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.600527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Returning 404 to user: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:56:18.600527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9e2c1d5f-b227-44e1-a101-a142039d74cb tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 404 len: 111 microversion: 2.20 time: 0.032616 Aug 30 14:56:18.600527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 656/1319] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 14:56:18 2022] DELETE /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:56:18.604942 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:18.605546 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 96e97534-d604-4593-8ebd-af7e01f58d5a] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:18.611597 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:18.611941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:18.614893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:18.614893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:18.614893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:18.614893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:18.628048 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] HTTP exception thrown: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Request method failure captured: Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a HTTP/1.1 Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiI-PxYP8QyaTIsRZGl8lYFVmVxS9kVkdh8QKkJRBXrmhdy7ZlMsHIIE4lWMJe99jpr19YL3cuNjicjOs3SQ43Sdrkh0wZIRKK0GM2dWDc6R9hrJFV1RvHOvuAg_K6crZylQrvdbn3UyT79U9FrwYpzW-qovgdXkJnsB_EUgv3PRWU4 Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:56:18.630394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21f6e5be24e448f9b981ad77d23de8bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 521cc5ea8fb045bc81e8e3bfa8ba239b Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.632382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '96e97534-d604-4593-8ebd-af7e01f58d5a'} Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:56:18.633472 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. Aug 30 14:56:18.635202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:18.636949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Returning 404 to user: Instance 96e97534-d604-4593-8ebd-af7e01f58d5a could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:56:18.636949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8eec244c-98a1-4a42-9e8b-8296a27f14a1 tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a" status: 404 len: 111 microversion: 2.20 time: 0.030197 Aug 30 14:56:18.636949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 664/1320] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:56:18 2022] GET /compute/v2.1/servers/96e97534-d604-4593-8ebd-af7e01f58d5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 14:56:19.190772 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:19.191367 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:19.197868 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:19.198354 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:19.198783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:19.199478 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:19.199925 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:19.200371 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:19.344098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:19.353461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a43a66c0-4dbd-43b6-89ea-1cdc4289ae8d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.166774 Aug 30 14:56:19.354686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 657/1321] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:19 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:56:19.785903 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:19.786460 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:19.793307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:19.793782 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:19.794208 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:19.794898 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:19.795339 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:19.795757 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:19.810180 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] HTTP exception thrown: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Request method failure captured: Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 HTTP/1.1 Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiI-PxYP8QyaTIsRZGl8lYFVmVxS9kVkdh8QKkJRBXrmhdy7ZlMsHIIE4lWMJe99jpr19YL3cuNjicjOs3SQ43Sdrkh0wZIRKK0GM2dWDc6R9hrJFV1RvHOvuAg_K6crZylQrvdbn3UyT79U9FrwYpzW-qovgdXkJnsB_EUgv3PRWU4 Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:56:19.811739 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21f6e5be24e448f9b981ad77d23de8bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 521cc5ea8fb045bc81e8e3bfa8ba239b Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.813466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '8c1622c2-5c2a-4656-b39c-0f2f520fcf52'} Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:56:19.814370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.815760 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.817390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Returning 404 to user: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:56:19.817390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6c8020f1-45f6-4352-b0dd-416f0b8c097c tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 404 len: 111 microversion: 2.20 time: 0.031216 Aug 30 14:56:19.817390 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 665/1322] 10.222.0.25 () {60 vars in 1280 bytes} [Tue Aug 30 14:56:19 2022] DELETE /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:56:19.821992 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:19.822726 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] [instance: 8c1622c2-5c2a-4656-b39c-0f2f520fcf52] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:19.829669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:19.830171 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:19.830628 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:19.831304 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:19.831743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:19.832190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:19.846028 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] HTTP exception thrown: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Request method failure captured: Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 HTTP/1.1 Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiI-PxYP8QyaTIsRZGl8lYFVmVxS9kVkdh8QKkJRBXrmhdy7ZlMsHIIE4lWMJe99jpr19YL3cuNjicjOs3SQ43Sdrkh0wZIRKK0GM2dWDc6R9hrJFV1RvHOvuAg_K6crZylQrvdbn3UyT79U9FrwYpzW-qovgdXkJnsB_EUgv3PRWU4 Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:56:19.847577 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/21f6e5be24e448f9b981ad77d23de8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_21f6e5be24e448f9b981ad77d23de8bd", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 21f6e5be24e448f9b981ad77d23de8bd Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-416791858 Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 521cc5ea8fb045bc81e8e3bfa8ba239b Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeShelveTestJSON-416791858-project Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.849497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '8c1622c2-5c2a-4656-b39c-0f2f520fcf52'} Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:56:19.850592 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. Aug 30 14:56:19.852128 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:56:19.853594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] Returning 404 to user: Instance 8c1622c2-5c2a-4656-b39c-0f2f520fcf52 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:56:19.853594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1efef04a-aaf4-4da3-a527-3c6d032e549d tempest-AttachVolumeShelveTestJSON-416791858 tempest-AttachVolumeShelveTestJSON-416791858-project] 10.222.0.25 "GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52" status: 404 len: 111 microversion: 2.20 time: 0.031083 Aug 30 14:56:19.853594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 658/1323] 10.222.0.25 () {60 vars in 1277 bytes} [Tue Aug 30 14:56:19 2022] GET /compute/v2.1/servers/8c1622c2-5c2a-4656-b39c-0f2f520fcf52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:56:20.374903 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:20.375510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:20.382018 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:20.382510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:20.382943 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:20.383626 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:20.384118 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:20.384535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:20.601391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:20.611932 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-166f6df7-0ef3-4c2b-ad4b-0140e3b84f25 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.240812 Aug 30 14:56:20.612536 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 666/1324] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:20 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:21.634791 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:21.635986 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:21.642820 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:21.643381 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:21.643890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:21.644694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:21.646150 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:21.646782 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:21.818564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:21.827791 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-d2d27522-1ff6-4af9-9739-c081b63702fa tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.196826 Aug 30 14:56:21.828413 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 659/1325] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:21 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:22.852902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:22.853673 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:22.869151 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:22.870906 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:22.875677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:22.876901 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:22.877152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:22.877923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:23.035802 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:23.045008 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-0a691703-c1cb-446d-bd2b-fdb02a733a1d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.198432 Aug 30 14:56:23.045585 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 667/1326] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:22 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:24.067026 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:24.068255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:24.074201 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:24.074670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:24.075098 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:24.075819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:24.076294 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:24.076686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:24.216802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:24.224965 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-a090419b-eff8-4e8c-bd07-e9fe39487357 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.162190 Aug 30 14:56:24.225731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 660/1327] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:24 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:56:25.245853 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:25.247251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:25.257748 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:25.258588 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:25.259183 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:25.260108 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:25.260872 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:25.261907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:25.417352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:25.426957 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-090b4d8c-0056-4394-bcfb-d2bdd0ddb9cd tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.184953 Aug 30 14:56:25.427536 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-a8eb7ddb-4656-4afb-ab4e-4b5d656a5ba8 req-2dd82f74-b15f-4f97-8f40-4b4d3e425c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9070b477-3eca-4c1e-aec3-251afda78787", "name": "network-vif-plugged", "status": "completed", "tag": "15aead72-d25a-4849-9e8f-8a9c86d1544a"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:56:25.428205 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 668/1328] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:25 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:25.439353 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a8eb7ddb-4656-4afb-ab4e-4b5d656a5ba8 req-2dd82f74-b15f-4f97-8f40-4b4d3e425c82 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:25.439775 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a8eb7ddb-4656-4afb-ab4e-4b5d656a5ba8 req-2dd82f74-b15f-4f97-8f40-4b4d3e425c82 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:25.440496 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-a8eb7ddb-4656-4afb-ab4e-4b5d656a5ba8 req-2dd82f74-b15f-4f97-8f40-4b4d3e425c82 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:25.453802 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-a8eb7ddb-4656-4afb-ab4e-4b5d656a5ba8 req-2dd82f74-b15f-4f97-8f40-4b4d3e425c82 service nova] Creating event network-vif-plugged:15aead72-d25a-4849-9e8f-8a9c86d1544a for instance 9070b477-3eca-4c1e-aec3-251afda78787 on hv-cinder-82880 Aug 30 14:56:25.459302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-a8eb7ddb-4656-4afb-ab4e-4b5d656a5ba8 req-2dd82f74-b15f-4f97-8f40-4b4d3e425c82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038108 Aug 30 14:56:25.460315 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 661/1329] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:56:26.448976 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:26.449536 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:26.456598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:26.457324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:26.457779 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:26.458834 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:26.459258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:26.459705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:26.602076 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:26.611623 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5049b9dc-bb7e-44aa-b196-8d7466d2dd7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.166478 Aug 30 14:56:26.612470 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 669/1330] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:26 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:27.635490 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:27.636725 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:27.644627 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:27.645338 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:27.645910 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:27.646909 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:27.647759 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:27.648369 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:28.069686 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:28.078565 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-82b6a96f-1472-4a34-976e-11ad910189f3 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1260 microversion: 2.1 time: 0.448064 Aug 30 14:56:28.079608 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 662/1331] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:27 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1260 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:29.101113 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:29.102538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:29.109535 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:29.110016 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:29.110443 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:29.111121 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:29.111750 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:29.112202 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:29.246664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:29.254805 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-98d37a2a-1eb9-47e7-b8ac-b1feaa16177e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1444 microversion: 2.1 time: 0.158359 Aug 30 14:56:29.255382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 670/1332] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:29 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:56:29.276044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:56:29.277296 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:56:29.284787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:29.284787 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:29.285157 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:29.286117 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:29.286798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:29.287632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:29.449799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:56:29.458333 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-276bb4e1-fb25-4222-86d7-6918d7fea3ad tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1444 microversion: 2.1 time: 0.186588 Aug 30 14:56:29.459149 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 663/1333] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:56:29 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1444 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:56:31.476153 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-08cd32b0-01dc-4080-b01b-4097179629db req-8bf1d68a-3c7f-4ba5-b9b5-40c90804fcfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9070b477-3eca-4c1e-aec3-251afda78787", "tag": "15aead72-d25a-4849-9e8f-8a9c86d1544a"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:56:31.487830 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-08cd32b0-01dc-4080-b01b-4097179629db req-8bf1d68a-3c7f-4ba5-b9b5-40c90804fcfe service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:56:31.488517 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-08cd32b0-01dc-4080-b01b-4097179629db req-8bf1d68a-3c7f-4ba5-b9b5-40c90804fcfe service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:56:31.489037 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-08cd32b0-01dc-4080-b01b-4097179629db req-8bf1d68a-3c7f-4ba5-b9b5-40c90804fcfe service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:56:31.496284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:56:31.504904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-08cd32b0-01dc-4080-b01b-4097179629db req-8bf1d68a-3c7f-4ba5-b9b5-40c90804fcfe service nova] Creating event network-changed:15aead72-d25a-4849-9e8f-8a9c86d1544a for instance 9070b477-3eca-4c1e-aec3-251afda78787 on hv-cinder-82880 Aug 30 14:56:31.513155 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-08cd32b0-01dc-4080-b01b-4097179629db req-8bf1d68a-3c7f-4ba5-b9b5-40c90804fcfe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039655 Aug 30 14:56:31.513944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 671/1334] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:57:24.068670 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=40 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:24.069417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=88 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:24.336920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:24.337419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:24.344114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:24.344589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:24.345013 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:24.345695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:24.346137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:24.346553 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:24.371266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-930fd78f-c59c-4f55-a9d2-bf0eee1ed94b tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/ips" status: 200 len: 151 microversion: 2.1 time: 0.307695 Aug 30 14:57:24.371844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 664/1335] 10.222.0.25 () {58 vars in 1248 bytes} [Tue Aug 30 14:57:24 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/ips => generated 151 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:57:25.728370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbfc472f-c08c-4438-8f26-29eec2f489ec"}} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:57:25.731904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:25.736143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:57:25.744562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:25.745212 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:25.745855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:25.746904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:25.747434 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:25.747980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:26.054099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b371d600-df91-4d9e-b389-9925e93b127d tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "POST /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331701 Aug 30 14:57:26.054777 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 672/1336] 10.222.0.25 () {60 vars in 1323 bytes} [Tue Aug 30 14:57:25 2022] POST /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:57:33.748146 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:33.748966 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:33.759296 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:33.760062 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:33.760783 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:33.761873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:33.762677 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:33.763095 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:33.854417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'services' on Instance uuid 964dd992-00cb-4b6c-96ad-8131be5ea962 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:57:33.933564 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-eef74435-5a53-48d1-9c50-b101c156e663 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments/dbfc472f-c08c-4438-8f26-29eec2f489ec" status: 202 len: 0 microversion: 2.1 time: 0.190296 Aug 30 14:57:33.934906 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 665/1337] 10.222.0.25 () {58 vars in 1416 bytes} [Tue Aug 30 14:57:33 2022] DELETE /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments/dbfc472f-c08c-4438-8f26-29eec2f489ec => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:57:33.945023 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:33.947452 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:33.954303 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:33.954824 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:33.955257 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:33.955929 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:33.956405 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:33.956840 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:33.988919 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-81de0d67-09ed-49b2-8d13-332bc7bd1b18 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048943 Aug 30 14:57:33.989483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 673/1338] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:57:33 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:57:35.006125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:35.008974 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:35.017691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:35.018172 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:35.018583 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:35.019297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:35.019743 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:35.020223 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:35.050385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-e1aebfb3-1bde-4a1c-a660-659ff3811750 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051413 Aug 30 14:57:35.050936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 666/1339] 10.222.0.25 () {58 vars in 1302 bytes} [Tue Aug 30 14:57:34 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:57:35.114106 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:35.114663 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:35.121143 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:35.121613 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:35.122043 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:35.122713 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:35.123175 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:35.123586 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:35.149065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:57:35.230860 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-10d93646-f9b0-40ef-a17d-8dba6e7e1243 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 204 len: 0 microversion: 2.1 time: 0.120299 Aug 30 14:57:35.231464 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 674/1340] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:57:35 2022] DELETE /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:57:35.240073 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:35.240704 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:35.247116 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:35.247589 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:35.248113 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:35.248720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:35.249145 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:35.249621 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:35.395385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:57:35.403676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-61451021-e6d1-4bd7-b00e-e096b6bfc58e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1683 microversion: 2.1 time: 0.167546 Aug 30 14:57:35.404271 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 667/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:35 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:57:36.433432 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:36.434123 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:36.441458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:36.441941 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:36.442374 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:36.443069 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:36.443515 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:36.443930 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:36.588964 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:57:36.597558 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-6e0ce0a8-f2e4-447e-86dd-ce17ba8f48db tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1683 microversion: 2.1 time: 0.168438 Aug 30 14:57:36.598136 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 675/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:36 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:57:37.619159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:37.619960 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:37.626917 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:37.627387 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:37.627827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:37.628576 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:37.629019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:37.629431 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:37.772359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:57:37.780457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9a75b47f-8aa1-4239-9862-52428cafddee tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1683 microversion: 2.1 time: 0.165232 Aug 30 14:57:37.781072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 668/1343] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:37 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:57:38.313584 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-af900830-869e-4d06-a4e7-6d2d21228f08 req-d77566da-e5b3-4e92-981b-78c37dd13a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964dd992-00cb-4b6c-96ad-8131be5ea962", "name": "network-vif-deleted", "tag": "f86c7ddb-c260-4366-8c96-fdf3844d1abe"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:57:38.332210 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-af900830-869e-4d06-a4e7-6d2d21228f08 req-d77566da-e5b3-4e92-981b-78c37dd13a7c service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:38.332548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-af900830-869e-4d06-a4e7-6d2d21228f08 req-d77566da-e5b3-4e92-981b-78c37dd13a7c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:38.333160 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-af900830-869e-4d06-a4e7-6d2d21228f08 req-d77566da-e5b3-4e92-981b-78c37dd13a7c service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:38.354395 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-af900830-869e-4d06-a4e7-6d2d21228f08 req-d77566da-e5b3-4e92-981b-78c37dd13a7c service nova] Creating event network-vif-deleted:f86c7ddb-c260-4366-8c96-fdf3844d1abe for instance 964dd992-00cb-4b6c-96ad-8131be5ea962 on hv-cinder-82880 Aug 30 14:57:38.362251 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-af900830-869e-4d06-a4e7-6d2d21228f08 req-d77566da-e5b3-4e92-981b-78c37dd13a7c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123953 Aug 30 14:57:38.363516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 676/1344] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:57:38.804479 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:38.805259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:38.811647 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:38.812196 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:38.812609 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:38.813340 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:38.814363 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:38.814835 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:38.848958 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:38.849532 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:38.850020 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:38.850468 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lazy-loading 'fault' on Instance uuid 964dd992-00cb-4b6c-96ad-8131be5ea962 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:57:38.892554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72e1a846e864aa8b00edd8ae1a948ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b0254ba7d0421e9d9214a1c400466a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:57:38.900873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-aec6f0b6-d3d7-4ea2-b678-a0a7510604da tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 200 len: 1332 microversion: 2.1 time: 0.100914 Aug 30 14:57:38.901456 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 669/1345] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:38 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:57:39.927247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:39.927926 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:39.935639 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:39.936214 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:39.936677 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:39.937434 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:39.937914 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:39.938373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:39.953022 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 HTTP/1.1 Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:57:39.954907 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:39.956745 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '964dd992-00cb-4b6c-96ad-8131be5ea962'} Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:39.958007 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:39.959682 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:39.961252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:39.961252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8f1a0469-9cc6-40ea-bee0-e9a1d399866a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 404 len: 111 microversion: 2.1 time: 0.034431 Aug 30 14:57:39.961252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 677/1346] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:39 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:39.966542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6bf2191a-1655-40d3-af30-a6e62e2edb95 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '.version_select at 0x7fe6a64d7700>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:39.988720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6bf2191a-1655-40d3-af30-a6e62e2edb95 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044555018" status: 202 len: 0 microversion: 2.1 time: 0.025970 Aug 30 14:57:39.989347 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 670/1347] 10.222.0.25 () {58 vars in 1221 bytes} [Tue Aug 30 14:57:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044555018 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:57:41.793354 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:41.793904 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:41.801395 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:41.801877 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:41.802335 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:41.803030 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:41.803501 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:41.803922 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:41.818458 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 HTTP/1.1 Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:57:41.820047 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.821568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '964dd992-00cb-4b6c-96ad-8131be5ea962'} Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:41.822427 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.824071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.825670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:41.825670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-5e8aa62c-edb7-4689-aae6-bb31721b7836 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 404 len: 111 microversion: 2.1 time: 0.031961 Aug 30 14:57:41.825670 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 678/1348] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:57:41 2022] DELETE /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:41.831025 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:41.831690 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 964dd992-00cb-4b6c-96ad-8131be5ea962] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:41.838372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:41.838774 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:41.839194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:41.839872 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:41.840481 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:41.840894 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:41.854525 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 HTTP/1.1 Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:57:41.856208 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.857883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '964dd992-00cb-4b6c-96ad-8131be5ea962'} Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:41.858748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. Aug 30 14:57:41.860127 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:41.861341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 964dd992-00cb-4b6c-96ad-8131be5ea962 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:41.861341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-fbbbfe44-e77b-4035-81a4-1f283693d4b7 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962" status: 404 len: 111 microversion: 2.1 time: 0.031358 Aug 30 14:57:41.861341 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 671/1349] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:41 2022] GET /compute/v2.1/servers/964dd992-00cb-4b6c-96ad-8131be5ea962 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:43.008855 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:43.009418 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:43.016398 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.016882 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.017316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.018003 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.018448 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.018869 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.032784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 HTTP/1.1 Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:57:43.034347 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.036102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '1f0b4a87-5efc-4610-a9a7-267fe31ce059'} Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:43.037215 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.038861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.040905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:43.040905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-cc03c77d-9fd0-4036-93d5-bedf5ba3033a tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 404 len: 111 microversion: 2.1 time: 0.030797 Aug 30 14:57:43.040905 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 679/1350] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:57:43 2022] DELETE /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:43.044594 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:43.045210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 1f0b4a87-5efc-4610-a9a7-267fe31ce059] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:43.052037 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.053102 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.053551 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.054250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.054706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.055111 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.069940 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 HTTP/1.1 Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:57:43.071487 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.073308 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '1f0b4a87-5efc-4610-a9a7-267fe31ce059'} Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:43.074219 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. Aug 30 14:57:43.075579 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.076850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 1f0b4a87-5efc-4610-a9a7-267fe31ce059 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:43.076850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-30a6bfdc-416c-40f4-9beb-943cf9fa7baf tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059" status: 404 len: 111 microversion: 2.1 time: 0.032159 Aug 30 14:57:43.076850 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 672/1351] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:43 2022] GET /compute/v2.1/servers/1f0b4a87-5efc-4610-a9a7-267fe31ce059 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:43.081416 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:43.081944 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:43.089036 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.089523 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.089960 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.090666 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.091112 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.091560 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.107266 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 HTTP/1.1 Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:57:43.109247 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.111323 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': 'f0a8e249-ce8d-48bd-af4e-ae32d0eed382'} Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:43.112412 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.113992 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.115980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:43.115980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-58a60910-a0cb-403e-991f-36418a26b1c1 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 404 len: 111 microversion: 2.1 time: 0.033159 Aug 30 14:57:43.115980 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 680/1352] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:57:43 2022] DELETE /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:43.119983 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:43.120649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: f0a8e249-ce8d-48bd-af4e-ae32d0eed382] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:43.127174 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.127682 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.128140 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.128827 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:43.129253 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:43.129669 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:43.143714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 HTTP/1.1 Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:57:43.145269 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.147027 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'f0a8e249-ce8d-48bd-af4e-ae32d0eed382'} Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:43.147873 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. Aug 30 14:57:43.149277 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:43.150527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance f0a8e249-ce8d-48bd-af4e-ae32d0eed382 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:43.150527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cb289d29-0fb6-4f34-b402-9eec62bce54e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382" status: 404 len: 111 microversion: 2.1 time: 0.030684 Aug 30 14:57:43.150527 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 673/1353] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:43 2022] GET /compute/v2.1/servers/f0a8e249-ce8d-48bd-af4e-ae32d0eed382 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:44.303678 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:44.304351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:44.310902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:44.311372 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:44.311811 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:44.312529 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:44.312981 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:44.313402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:44.327409 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 HTTP/1.1 Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:57:44.329021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.331235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '6bec4834-0075-439c-bca0-5c5abf786d13'} Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:44.332415 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.334665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.336411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:44.336411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7539e918-d72d-4f74-bdf0-ad78fb3a2e83 tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 404 len: 111 microversion: 2.1 time: 0.030907 Aug 30 14:57:44.336411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 681/1354] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:57:44 2022] DELETE /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:57:44.339209 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:57:44.339815 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] [instance: 6bec4834-0075-439c-bca0-5c5abf786d13] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:57:44.346359 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:44.346818 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:44.347270 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:44.348032 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:57:44.348502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:57:44.348924 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:57:44.363036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] HTTP exception thrown: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Request method failure captured: Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 HTTP/1.1 Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiLEQ5BHu8y0yDKycMX0IxNVSeFupVmUOn7zOY8eoslzgf92avpiyXfKZU6P3uq_5rKMXQoUr3s_WqWd63y5GfOo2AX-qG6v_FLpuUW0zv8yW1w3ivJkGL3KbJ9tcD_1U2VrgjAaR4Dm69lXx4hBHZ6WcmwquDMKIgR_ZfeavjisGfE Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:57:44.364615 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/11b0254ba7d0421e9d9214a1c400466a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_11b0254ba7d0421e9d9214a1c400466a", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 11b0254ba7d0421e9d9214a1c400466a Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1390541111 Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: f72e1a846e864aa8b00edd8ae1a948ff Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-AttachVolumeNegativeTest-1390541111-project Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.366461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '6bec4834-0075-439c-bca0-5c5abf786d13'} Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:57:44.367500 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. Aug 30 14:57:44.369210 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:57:44.370801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] Returning 404 to user: Instance 6bec4834-0075-439c-bca0-5c5abf786d13 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:57:44.370801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-cc63062c-aaca-4edb-8b49-cae6f213b38e tempest-AttachVolumeNegativeTest-1390541111 tempest-AttachVolumeNegativeTest-1390541111-project] 10.222.0.25 "GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13" status: 404 len: 111 microversion: 2.1 time: 0.030686 Aug 30 14:57:44.370801 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 674/1355] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:57:44 2022] GET /compute/v2.1/servers/6bec4834-0075-439c-bca0-5c5abf786d13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:03.366064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:03.366660 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:03.369665 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-3f1f9db7-ebf8-4dcb-945a-1897cca5972f req-05a5e933-7481-42c9-9c4c-2f4199e9dd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49eaa066-a6bd-47bf-8063-4ce93ccc53d4", "tag": "e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:58:03.370902 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:03.371548 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:03.375706 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:03.376222 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:03.376656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:03.377338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:03.377786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:03.378088 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:58:03.378302 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Tue Aug 30 14:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 30 14:58:03.378786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:03.379620 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:03.380721 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:03.396539 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3f1f9db7-ebf8-4dcb-945a-1897cca5972f req-05a5e933-7481-42c9-9c4c-2f4199e9dd0d service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:03.397126 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3f1f9db7-ebf8-4dcb-945a-1897cca5972f req-05a5e933-7481-42c9-9c4c-2f4199e9dd0d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:03.397676 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-3f1f9db7-ebf8-4dcb-945a-1897cca5972f req-05a5e933-7481-42c9-9c4c-2f4199e9dd0d service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:03.411457 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-3f1f9db7-ebf8-4dcb-945a-1897cca5972f req-05a5e933-7481-42c9-9c4c-2f4199e9dd0d service nova] Creating event network-changed:e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747 for instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 on hv-cinder-82880 Aug 30 14:58:03.414598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:58:03.416893 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-3f1f9db7-ebf8-4dcb-945a-1897cca5972f req-05a5e933-7481-42c9-9c4c-2f4199e9dd0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051033 Aug 30 14:58:03.417604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 675/1356] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:58:03.510963 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-604bdc9e-5159-4196-b4cf-b41c16fbbf31 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "DELETE /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 204 len: 0 microversion: 2.1 time: 0.148161 Aug 30 14:58:03.520876 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 682/1357] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:58:03 2022] DELETE /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:58:03.531578 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:03.533661 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:03.540385 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:03.540860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:03.541505 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:03.542199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:03.542641 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:03.543137 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:03.691499 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:03.699949 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0c388a12-bf34-4800-a14c-f4719d62f3d7 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1577 microversion: 2.1 time: 0.174677 Aug 30 14:58:03.708191 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 676/1358] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:03 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:04.726021 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:04.726590 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:04.733262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:04.733746 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:04.734167 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:04.735064 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:04.735468 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:04.736664 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:04.870994 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:04.879227 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8322fd04-77de-441b-992b-d0046f7692f1 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1577 microversion: 2.1 time: 0.157588 Aug 30 14:58:04.879789 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 683/1359] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:04 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:05.902155 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:05.903086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:05.911825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:05.912355 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:05.912793 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:05.913635 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:05.914085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:05.914699 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:05.916701 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-a21dd67f-83d8-44d4-b140-3c4b46adda12 req-beeffb46-a91e-4d23-b3a6-fbfbb9fc4555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49eaa066-a6bd-47bf-8063-4ce93ccc53d4", "name": "network-vif-deleted", "tag": "e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:58:05.927351 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-a21dd67f-83d8-44d4-b140-3c4b46adda12 req-beeffb46-a91e-4d23-b3a6-fbfbb9fc4555 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:05.927861 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-a21dd67f-83d8-44d4-b140-3c4b46adda12 req-beeffb46-a91e-4d23-b3a6-fbfbb9fc4555 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:05.928474 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-a21dd67f-83d8-44d4-b140-3c4b46adda12 req-beeffb46-a91e-4d23-b3a6-fbfbb9fc4555 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:05.940715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-a21dd67f-83d8-44d4-b140-3c4b46adda12 req-beeffb46-a91e-4d23-b3a6-fbfbb9fc4555 service nova] Creating event network-vif-deleted:e1f5ac0d-ffe6-4ab5-97ce-e8ed1dddc747 for instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 on hv-cinder-82880 Aug 30 14:58:05.946391 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-a21dd67f-83d8-44d4-b140-3c4b46adda12 req-beeffb46-a91e-4d23-b3a6-fbfbb9fc4555 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Aug 30 14:58:05.947358 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 684/1360] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:58:05.984022 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:05.992241 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-089dbd52-d11d-4af0-8bf5-0f16c73b4681 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 200 len: 1390 microversion: 2.1 time: 0.094871 Aug 30 14:58:05.992812 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 677/1361] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:05 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:58:07.015924 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:07.016635 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 49eaa066-a6bd-47bf-8063-4ce93ccc53d4] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:07.023878 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:07.024466 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:07.024938 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:07.025637 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:07.026084 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:07.026506 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:07.048923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] HTTP exception thrown: Instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 could not be found. Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Request method failure captured: Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 HTTP/1.1 Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiMUaOd6bwCeOVB0IyBSLu-XRvG3fE6Bb9AwmXNe_rjf2yc2I1J8w1hqBxvoJDm3ayhFITVYkiLLfW305GxYNvKQ9sZBodpd_H1fPPLFCvOLpYX2fG8YVnMb4_bWuE_NJE8jGqjtzZ3ajFSMuv9ae9Bv7Ovkx0aCrQ0xhJctE_rqu0Q Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:58:07.051338 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86111e1d9f5b485abf57231b21b3a5e9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 06ab23cfa18e47c9871c6f451b871ef2 Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 could not be found. Aug 30 14:58:07.053193 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '49eaa066-a6bd-47bf-8063-4ce93ccc53d4'} Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 could not be found. Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:58:07.054265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 could not be found. Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 could not be found. Aug 30 14:58:07.056025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:07.057505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Returning 404 to user: Instance 49eaa066-a6bd-47bf-8063-4ce93ccc53d4 could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:58:07.057505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-b8966c97-2462-46b7-a0bc-8c4ad1865e88 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4" status: 404 len: 111 microversion: 2.1 time: 0.041946 Aug 30 14:58:07.057505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 685/1362] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:07 2022] GET /compute/v2.1/servers/49eaa066-a6bd-47bf-8063-4ce93ccc53d4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:10.496711 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:10.497317 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:10.498355 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-60ccf079-5c39-4176-88b4-d9dc37d154cd req-62395954-a06d-4fd2-9996-f5d628845939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeabde5d-dfc1-47a8-a15b-47938a678196", "tag": "7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:58:10.504678 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:10.505504 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:10.506002 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:10.506819 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:10.507275 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:10.507756 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:10.509596 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-60ccf079-5c39-4176-88b4-d9dc37d154cd req-62395954-a06d-4fd2-9996-f5d628845939 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:10.510078 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-60ccf079-5c39-4176-88b4-d9dc37d154cd req-62395954-a06d-4fd2-9996-f5d628845939 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:10.510513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-60ccf079-5c39-4176-88b4-d9dc37d154cd req-62395954-a06d-4fd2-9996-f5d628845939 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:10.523759 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-60ccf079-5c39-4176-88b4-d9dc37d154cd req-62395954-a06d-4fd2-9996-f5d628845939 service nova] Creating event network-changed:7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6 for instance aeabde5d-dfc1-47a8-a15b-47938a678196 on hv-cinder-82880 Aug 30 14:58:10.529254 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-60ccf079-5c39-4176-88b4-d9dc37d154cd req-62395954-a06d-4fd2-9996-f5d628845939 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034791 Aug 30 14:58:10.530322 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 686/1363] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:58:10.536896 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Going to try to terminate instance {{(pid=127177) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:58:10.640426 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-251ad9f7-8df7-4f42-819e-eecc8e010abb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 204 len: 0 microversion: 2.1 time: 0.143054 Aug 30 14:58:10.641086 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 678/1364] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:58:10 2022] DELETE /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:58:10.649854 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:10.650883 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:10.657428 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:10.658107 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:10.658723 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:10.659593 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:10.660235 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:10.660809 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:10.799265 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:10.807513 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-33437b4e-7544-4bbd-a28e-555ac7d7ea17 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1576 microversion: 2.1 time: 0.161932 Aug 30 14:58:10.808113 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 687/1365] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:10 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:11.831246 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:11.831867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:11.839085 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:11.839567 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:11.840016 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:11.840854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:11.841309 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:11.841731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:11.907014 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06ab23cfa18e47c9871c6f451b871ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86111e1d9f5b485abf57231b21b3a5e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:11.915748 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-34aa7cf4-554b-4a61-8a9e-ca84d5be9eeb tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 200 len: 1389 microversion: 2.1 time: 0.089756 Aug 30 14:58:11.916365 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 679/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:11 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:12.545045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-fb64b655-7284-4bcc-ab43-116a907417e3 req-da9c71c7-c8ab-4e11-9358-fa2b4a902862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeabde5d-dfc1-47a8-a15b-47938a678196", "name": "network-vif-deleted", "tag": "7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:58:12.555923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-fb64b655-7284-4bcc-ab43-116a907417e3 req-da9c71c7-c8ab-4e11-9358-fa2b4a902862 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:12.556524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-fb64b655-7284-4bcc-ab43-116a907417e3 req-da9c71c7-c8ab-4e11-9358-fa2b4a902862 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:12.557035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-fb64b655-7284-4bcc-ab43-116a907417e3 req-da9c71c7-c8ab-4e11-9358-fa2b4a902862 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:12.569482 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-fb64b655-7284-4bcc-ab43-116a907417e3 req-da9c71c7-c8ab-4e11-9358-fa2b4a902862 service nova] Creating event network-vif-deleted:7d849e3e-fe5c-4108-bb10-3ca50a4cd5e6 for instance aeabde5d-dfc1-47a8-a15b-47938a678196 on hv-cinder-82880 Aug 30 14:58:12.574741 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-fb64b655-7284-4bcc-ab43-116a907417e3 req-da9c71c7-c8ab-4e11-9358-fa2b4a902862 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033437 Aug 30 14:58:12.575320 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 688/1367] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:58:12.943845 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:12.944691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: aeabde5d-dfc1-47a8-a15b-47938a678196] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:12.953685 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:12.954333 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:12.954806 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:12.955714 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:12.956397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:12.957297 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:12.973640 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] HTTP exception thrown: Instance aeabde5d-dfc1-47a8-a15b-47938a678196 could not be found. Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Request method failure captured: Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 HTTP/1.1 Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiMUaOd6bwCeOVB0IyBSLu-XRvG3fE6Bb9AwmXNe_rjf2yc2I1J8w1hqBxvoJDm3ayhFITVYkiLLfW305GxYNvKQ9sZBodpd_H1fPPLFCvOLpYX2fG8YVnMb4_bWuE_NJE8jGqjtzZ3ajFSMuv9ae9Bv7Ovkx0aCrQ0xhJctE_rqu0Q Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:58:12.975328 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86111e1d9f5b485abf57231b21b3a5e9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 06ab23cfa18e47c9871c6f451b871ef2 Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance aeabde5d-dfc1-47a8-a15b-47938a678196 could not be found. Aug 30 14:58:12.977169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': 'aeabde5d-dfc1-47a8-a15b-47938a678196'} Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeabde5d-dfc1-47a8-a15b-47938a678196 could not be found. Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:58:12.978256 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeabde5d-dfc1-47a8-a15b-47938a678196 could not be found. Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeabde5d-dfc1-47a8-a15b-47938a678196 could not be found. Aug 30 14:58:12.980044 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:12.981757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Returning 404 to user: Instance aeabde5d-dfc1-47a8-a15b-47938a678196 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:58:12.981757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7a5aab67-9bfa-4132-ac12-e366577adb3e tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196" status: 404 len: 111 microversion: 2.1 time: 0.039125 Aug 30 14:58:12.981757 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 680/1368] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:12 2022] GET /compute/v2.1/servers/aeabde5d-dfc1-47a8-a15b-47938a678196 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:13.470467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:13.471046 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:13.477538 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:13.478065 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:13.478495 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:13.479164 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:13.479610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:13.480046 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:13.493718 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.wsgi [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] HTTP exception thrown: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Request method failure captured: Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: request: DELETE /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f HTTP/1.1 Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept: application/json Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Accept-Encoding: identity Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Connection: close Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Length: 0 Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Content-Type: application/json Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Host: 10.222.0.25 Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: Openstack-System-Scope: None Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: User-Agent: python-urllib3/1.26.12 Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Auth-Token: gAAAAABjDiMUaOd6bwCeOVB0IyBSLu-XRvG3fE6Bb9AwmXNe_rjf2yc2I1J8w1hqBxvoJDm3ayhFITVYkiLLfW305GxYNvKQ9sZBodpd_H1fPPLFCvOLpYX2fG8YVnMb4_bWuE_NJE8jGqjtzZ3ajFSMuv9ae9Bv7Ovkx0aCrQ0xhJctE_rqu0Q Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Id: None Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Domain-Name: None Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Identity-Status: Confirmed Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Is-Admin-Project: True Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Id: default Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Domain-Name: Default Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Project-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Role: reader,member Aug 30 14:58:13.495387 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Roles: reader,member Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86111e1d9f5b485abf57231b21b3a5e9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-Tenant-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Id: default Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Domain-Name: Default Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Id: 06ab23cfa18e47c9871c6f451b871ef2 Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: X-User-Name: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: method: > Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: exception: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.497217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: action_args: {'id': '74db9a17-f60a-45f7-a911-343fc374f92f'} Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:58:13.498442 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.500102 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.501837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Returning 404 to user: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. {{(pid=127176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:58:13.501837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1aead39a-2a29-42d5-a9f0-6d7339f51490 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "DELETE /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 404 len: 111 microversion: 2.1 time: 0.030889 Aug 30 14:58:13.501837 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 689/1369] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 14:58:13 2022] DELETE /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:13.505656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:13.506303 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] [instance: 74db9a17-f60a-45f7-a911-343fc374f92f] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:13.513286 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:13.513778 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:13.514212 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:13.514904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:13.515390 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:13.515867 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:13.533114 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] HTTP exception thrown: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Request method failure captured: Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f HTTP/1.1 Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiMUaOd6bwCeOVB0IyBSLu-XRvG3fE6Bb9AwmXNe_rjf2yc2I1J8w1hqBxvoJDm3ayhFITVYkiLLfW305GxYNvKQ9sZBodpd_H1fPPLFCvOLpYX2fG8YVnMb4_bWuE_NJE8jGqjtzZ3ajFSMuv9ae9Bv7Ovkx0aCrQ0xhJctE_rqu0Q Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 14:58:13.534695 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/86111e1d9f5b485abf57231b21b3a5e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_86111e1d9f5b485abf57231b21b3a5e9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: 86111e1d9f5b485abf57231b21b3a5e9 Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestVolumeBootPattern-122287709 Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 06ab23cfa18e47c9871c6f451b871ef2 Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestVolumeBootPattern-122287709-project Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.536556 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '74db9a17-f60a-45f7-a911-343fc374f92f'} Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:58:13.537829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. Aug 30 14:58:13.539597 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 14:58:13.541526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Returning 404 to user: Instance 74db9a17-f60a-45f7-a911-343fc374f92f could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:58:13.541526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-b000d058-22cb-4bcc-a687-41665df3b9c3 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f" status: 404 len: 111 microversion: 2.1 time: 0.034397 Aug 30 14:58:13.541526 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 681/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:13 2022] GET /compute/v2.1/servers/74db9a17-f60a-45f7-a911-343fc374f92f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:58:18.034359 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-a43abcda-ba61-44e4-bcf2-38fc90f47937 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] Calling method '.version_select at 0x7fe6a61b9ee0>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:18.058859 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-a43abcda-ba61-44e4-bcf2-38fc90f47937 tempest-TestVolumeBootPattern-122287709 tempest-TestVolumeBootPattern-122287709-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495216325" status: 202 len: 0 microversion: 2.1 time: 0.028549 Aug 30 14:58:18.059646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 690/1371] 10.222.0.25 () {58 vars in 1260 bytes} [Tue Aug 30 14:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-495216325 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 14:59:01.367546 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:59:01.368233 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:01.370768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:01.371417 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:01.378461 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:01.378984 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:01.379515 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:01.380255 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:01.380694 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:01.381109 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:01.406163 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.objects.instance [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lazy-loading 'flavor' on Instance uuid 9070b477-3eca-4c1e-aec3-251afda78787 {{(pid=127177) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:59:01.488813 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-1d9dafaf-c7ca-4e44-8fe0-e7ae453d63ec tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "POST /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787/action" status: 202 len: 0 microversion: 2.1 time: 0.124973 Aug 30 14:59:01.489439 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 682/1372] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:59:01 2022] POST /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:59:01.495077 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:01.496035 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:01.500440 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:01.501048 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:01.509521 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:01.510217 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:01.510751 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:01.511610 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:01.512083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:01.512516 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:01.662710 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:01.670923 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-e42b7ebb-d397-4797-be5c-5161472a08ae tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.176980 Aug 30 14:59:01.671455 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 691/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:01 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:02.694731 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:02.695319 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:02.702708 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:02.703192 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:02.703626 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:02.704431 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:02.704994 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:02.705419 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:02.863072 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:02.871323 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-7694c2e7-307a-4c53-8963-c1db1baaa548 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.182224 Aug 30 14:59:02.871899 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 683/1374] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:02 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:03.902312 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:03.903057 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:03.909761 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:03.910242 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:03.910709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:03.911402 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:03.911846 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:03.912285 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:04.051851 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:04.060040 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3b1250d0-f378-4582-bc76-fb2ffffdad17 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.166865 Aug 30 14:59:04.060644 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 692/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:03 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:05.081170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:05.081799 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:05.088932 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:05.089423 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:05.089854 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:05.090574 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:05.091013 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:05.091437 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:05.422372 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:05.430637 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2d0f6300-0696-4f49-8f04-e3741904dfdf tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.353437 Aug 30 14:59:05.431257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 684/1376] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:05 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:06.461467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:06.462233 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:06.470435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:06.470435 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:06.470676 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:06.471234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:06.472603 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:06.473385 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:06.612956 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:06.622520 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7f08807a-68c0-40d3-91d4-8e8b895a5f9b tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.166790 Aug 30 14:59:06.623105 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 693/1377] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:06 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:07.644287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:07.644890 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:07.652033 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:07.652522 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:07.653143 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:07.653895 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:07.654401 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:07.654883 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:07.799921 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:07.808332 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-5ff67158-f7c1-4442-8df8-977d215cb5d8 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.168108 Aug 30 14:59:07.808913 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 685/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:07 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:08.830281 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:08.830848 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:08.839086 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:08.839562 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:08.839973 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:08.840692 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:08.841467 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:08.841606 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:09.219258 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:09.227300 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-abb3be22-1774-42eb-9d21-3aaf17777089 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.401072 Aug 30 14:59:09.227893 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 694/1379] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:08 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:10.252075 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:10.252943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:10.261829 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:10.262469 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:10.263129 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:10.264169 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:10.264664 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:10.265093 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:10.410000 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:10.418218 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0a4329ab-101d-4913-8389-ca14a421280f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.171108 Aug 30 14:59:10.418784 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 686/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:10 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:11.440017 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:11.440831 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:11.448399 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:11.449146 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:11.449784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:11.450505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:11.450949 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:11.451331 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:11.595318 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:11.606483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-29cd41b2-b90c-4385-ae6d-39dee84519b5 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.171248 Aug 30 14:59:11.607316 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 695/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:11 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:12.627643 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:12.628257 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:12.635301 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:12.635789 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:12.636253 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:12.636944 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:12.637397 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:12.637805 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:12.778602 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:12.787259 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-379f7b9c-54d8-4d75-9d7d-f84f5b2988ce tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.163683 Aug 30 14:59:12.787836 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 687/1382] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:12 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:13.810966 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:13.811568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:13.818294 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:13.818786 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:13.819209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:13.819894 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:13.820369 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:13.820803 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:13.962373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:13.974207 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d7cebf25-b1b4-4122-adc9-c44e52bbbb4f tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.166938 Aug 30 14:59:13.974808 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 696/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:13 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:14.998360 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:14.998980 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:15.006803 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:15.007305 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:15.007730 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:15.008476 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:15.008943 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:15.009310 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:15.154584 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:15.163563 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-41567cae-ec7e-4cf4-915d-abb318ca5e7e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.169831 Aug 30 14:59:15.164175 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 688/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:14 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:16.186675 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:16.187446 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:16.195158 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:16.195772 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:16.196483 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:16.197345 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:16.197908 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:16.198373 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:16.385152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:16.394066 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-7db68eb0-8e80-44b5-bfcb-96086988642e tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.212184 Aug 30 14:59:16.395352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 697/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:16 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:17.416722 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:17.417474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:17.424473 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:17.424938 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:17.425603 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:17.426429 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:17.426926 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:17.427336 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:17.608106 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:17.616036 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-6fd3a12f-0886-426f-acbf-96d47726900d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.203631 Aug 30 14:59:17.616703 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 689/1386] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:17 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:18.636982 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:18.637568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:18.645524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:18.646709 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:18.647307 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:18.648067 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:18.648510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:18.648924 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:18.811128 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:18.821646 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-8a60114f-1982-4c6b-acda-2aee45ab0234 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.188441 Aug 30 14:59:18.822572 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 698/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:18 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:19.845656 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:19.846266 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:19.853021 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:19.853497 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:19.853929 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:19.854627 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:19.855092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:19.855542 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:19.994190 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:20.005199 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-62e2c8e9-d737-499a-9fd6-626138416c08 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1510 microversion: 2.1 time: 0.163290 Aug 30 14:59:20.006038 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 690/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:19 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:20.026137 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:59:20.027336 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:20.034528 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.035103 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.035583 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.036576 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.037137 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.037890 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.092083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127176) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 14:59:20.185674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-caee8786-9584-419e-ac6e-07d3970ec607 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "POST /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787/action" status: 202 len: 0 microversion: 2.1 time: 0.163775 Aug 30 14:59:20.186570 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 699/1389] 10.222.0.25 () {60 vars in 1278 bytes} [Tue Aug 30 14:59:20 2022] POST /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:59:20.196467 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:20.197343 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:20.206687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.207601 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.208285 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.209182 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.209878 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.210345 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.355194 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:20.363768 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-47fef604-2e92-4e3d-9a2a-6d609b6f9cda tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1518 microversion: 2.1 time: 0.172772 Aug 30 14:59:20.364554 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 691/1390] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:20 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:59:21.385765 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:21.386425 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:21.393401 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:21.394114 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:21.394625 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:21.395386 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:21.395945 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:21.396394 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:21.543826 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:21.556324 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-36206cfb-1da1-4f52-b1b9-223ab18158f4 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1520 microversion: 2.1 time: 0.174741 Aug 30 14:59:21.557685 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 700/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:21 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:22.583400 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:22.584238 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:22.590715 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:22.591164 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:22.591622 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:22.592350 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:22.592798 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:22.593215 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:22.727082 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:22.735125 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-bee53f26-b865-4f6a-bdc8-805155c953b6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.160320 Aug 30 14:59:22.735687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 692/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:22 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:23.353083 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [req-7743577c-4edd-4ffb-9fdc-f8c0bbb4e6af req-eaf4f0aa-9db2-4b51-9544-3d0ffc4c6b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9070b477-3eca-4c1e-aec3-251afda78787", "name": "network-vif-unplugged", "status": "completed", "tag": "15aead72-d25a-4849-9e8f-8a9c86d1544a"}]} {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:59:23.363968 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7743577c-4edd-4ffb-9fdc-f8c0bbb4e6af req-eaf4f0aa-9db2-4b51-9544-3d0ffc4c6b2a service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:23.364754 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7743577c-4edd-4ffb-9fdc-f8c0bbb4e6af req-eaf4f0aa-9db2-4b51-9544-3d0ffc4c6b2a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:23.365246 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [req-7743577c-4edd-4ffb-9fdc-f8c0bbb4e6af req-eaf4f0aa-9db2-4b51-9544-3d0ffc4c6b2a service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:23.379152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.compute.server_external_events [req-7743577c-4edd-4ffb-9fdc-f8c0bbb4e6af req-eaf4f0aa-9db2-4b51-9544-3d0ffc4c6b2a service nova] Creating event network-vif-unplugged:15aead72-d25a-4849-9e8f-8a9c86d1544a for instance 9070b477-3eca-4c1e-aec3-251afda78787 on hv-cinder-82880 Aug 30 14:59:23.385163 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [req-7743577c-4edd-4ffb-9fdc-f8c0bbb4e6af req-eaf4f0aa-9db2-4b51-9544-3d0ffc4c6b2a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035788 Aug 30 14:59:23.386514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 701/1393] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:59:23.758520 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:23.759091 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:23.765977 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:23.766442 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:23.766860 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:23.767512 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:23.767971 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:23.768412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:23.908342 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:23.916908 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-2785452d-956f-4ffc-9c97-c4a8e6699123 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.162536 Aug 30 14:59:23.917486 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 693/1394] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:23 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:24.940147 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:24.940983 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:24.948070 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:24.948578 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:24.948999 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:24.949696 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:24.950130 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:24.950544 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:25.102131 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:25.112514 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-f9587ef0-3455-410d-8cbc-18e4f7a4800c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.177158 Aug 30 14:59:25.113071 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 702/1395] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:24 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:26.134395 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:26.135041 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:26.141680 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:26.142159 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:26.142587 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:26.143346 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:26.143720 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:26.144170 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:26.284245 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:26.293012 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8eb19e6b-4a80-4ba9-993c-687e43f9fc89 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.162512 Aug 30 14:59:26.293844 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 694/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:26 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:27.315292 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:27.315955 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:27.326662 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:27.327234 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:27.327674 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:27.328411 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:27.329003 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:27.329566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:27.470393 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:27.478532 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3af85c35-a19f-4593-aa84-59d087d0e923 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.167966 Aug 30 14:59:27.479099 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 703/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:27 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:28.501016 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:28.501713 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:28.508856 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:28.509312 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:28.509737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:28.510410 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:28.510857 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:28.511273 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:28.655115 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:28.663507 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-9b8ee531-c017-43ef-95b8-aadb6e509e7d tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.166452 Aug 30 14:59:28.664101 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 695/1398] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:28 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:29.685656 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:29.686264 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:29.693120 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:29.693598 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:29.694008 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:29.694784 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:29.695296 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:29.695715 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:29.846916 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:29.855720 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-4a202e89-8f8f-418a-8ca2-19a0341dcd9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.174200 Aug 30 14:59:29.856339 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 704/1399] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:29 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:30.878079 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:30.878687 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:30.885691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:30.886141 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:30.886604 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:30.887282 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:30.887723 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:30.888184 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:30.908474 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:31.027936 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:31.035919 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-0bc3a48c-95e2-4fbc-83b8-ddac7bfda538 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1576 microversion: 2.1 time: 0.161872 Aug 30 14:59:31.036524 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 696/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:30 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:32.057989 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:32.058838 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:32.061284 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:32.066344 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:32.067055 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:32.067665 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:32.068407 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:32.068844 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:32.069263 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:32.074568 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:32.238252 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:32.247315 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-3441b4ec-2265-47a5-a01e-b886d3199a9a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1563 microversion: 2.1 time: 0.193206 Aug 30 14:59:32.247969 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 705/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:32 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1563 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:33.455510 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-70a26c3a-74e9-4a44-807e-72a8e48dc3c6 req-95903bc3-0df2-41ff-97e0-dd3a1adebff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9070b477-3eca-4c1e-aec3-251afda78787", "name": "network-vif-plugged", "status": "completed", "tag": "15aead72-d25a-4849-9e8f-8a9c86d1544a"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:59:33.461080 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=31 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:33.467517 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-70a26c3a-74e9-4a44-807e-72a8e48dc3c6 req-95903bc3-0df2-41ff-97e0-dd3a1adebff9 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:33.468019 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-70a26c3a-74e9-4a44-807e-72a8e48dc3c6 req-95903bc3-0df2-41ff-97e0-dd3a1adebff9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:33.468450 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-70a26c3a-74e9-4a44-807e-72a8e48dc3c6 req-95903bc3-0df2-41ff-97e0-dd3a1adebff9 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:33.480892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-70a26c3a-74e9-4a44-807e-72a8e48dc3c6 req-95903bc3-0df2-41ff-97e0-dd3a1adebff9 service nova] Creating event network-vif-plugged:15aead72-d25a-4849-9e8f-8a9c86d1544a for instance 9070b477-3eca-4c1e-aec3-251afda78787 on hv-cinder-82880 Aug 30 14:59:33.485979 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-70a26c3a-74e9-4a44-807e-72a8e48dc3c6 req-95903bc3-0df2-41ff-97e0-dd3a1adebff9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034253 Aug 30 14:59:33.486737 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 697/1402] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 14:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:01:00.372632 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:01:00.373284 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Tue Aug 30 15:01:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.25) !!! Aug 30 15:01:00.374444 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_api:SELECT=1 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:00.375722 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG dbcounter [-] [127176] Writing DB stats nova_cell1:SELECT=5 {{(pid=127176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:00.381815 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:00.382309 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:00.386769 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_cell1:SELECT=4 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:00.387920 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG dbcounter [-] [127177] Writing DB stats nova_api:SELECT=1 {{(pid=127177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:00.393706 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-9f0468ce-d047-4f73-8e6d-0b418c98a27a req-00255aa6-9466-4fb6-a1a4-536198ad9e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9070b477-3eca-4c1e-aec3-251afda78787", "tag": "15aead72-d25a-4849-9e8f-8a9c86d1544a"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:01:00.403732 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.404262 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.404694 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.405624 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.406062 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.406505 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.413077 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9f0468ce-d047-4f73-8e6d-0b418c98a27a req-00255aa6-9466-4fb6-a1a4-536198ad9e24 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.413503 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9f0468ce-d047-4f73-8e6d-0b418c98a27a req-00255aa6-9466-4fb6-a1a4-536198ad9e24 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.413919 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-9f0468ce-d047-4f73-8e6d-0b418c98a27a req-00255aa6-9466-4fb6-a1a4-536198ad9e24 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.427142 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-9f0468ce-d047-4f73-8e6d-0b418c98a27a req-00255aa6-9466-4fb6-a1a4-536198ad9e24 service nova] Creating event network-changed:15aead72-d25a-4849-9e8f-8a9c86d1544a for instance 9070b477-3eca-4c1e-aec3-251afda78787 on hv-cinder-82880 Aug 30 15:01:00.433001 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-9f0468ce-d047-4f73-8e6d-0b418c98a27a req-00255aa6-9466-4fb6-a1a4-536198ad9e24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062399 Aug 30 15:01:00.433959 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 698/1403] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 15:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:01:00.438566 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Going to try to terminate instance {{(pid=127176) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:01:00.527013 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-1dc1c8a4-76cf-4262-bfcc-db5279eed4b2 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "DELETE /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 204 len: 0 microversion: 2.1 time: 0.158980 Aug 30 15:01:00.527759 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 706/1404] 10.222.0.25 () {58 vars in 1239 bytes} [Tue Aug 30 15:01:00 2022] DELETE /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:01:00.540992 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:00.542000 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:00.552464 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.553283 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.553724 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.554428 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.554876 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.555287 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.708904 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.policy [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127177) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:00.716892 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-16ae978d-46d0-4529-97a8-cf4710f3103c tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.182442 Aug 30 15:01:00.717447 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 699/1405] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:00 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:01.739437 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:01.741299 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:01.747990 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.748766 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.749352 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.750156 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.750705 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.751219 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.912382 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:01.921270 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-57946e2c-f9c3-4d40-bd16-954904893f8a tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1569 microversion: 2.1 time: 0.186087 Aug 30 15:01:01.921847 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 707/1406] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:01 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:02.942711 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:02.943370 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.compute.api [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127176) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:02.949951 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:02.950439 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:02.951025 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:02.951573 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:02.952045 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:02.952510 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG oslo_concurrency.lockutils [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:02.964185 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [req-58fd31b4-cbe2-45d6-b370-f0b408bb8f24 req-4958e7b8-38e8-4a15-bb46-8dee0180e4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9070b477-3eca-4c1e-aec3-251afda78787", "name": "network-vif-deleted", "tag": "15aead72-d25a-4849-9e8f-8a9c86d1544a"}]} {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:01:02.973649 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-58fd31b4-cbe2-45d6-b370-f0b408bb8f24 req-4958e7b8-38e8-4a15-bb46-8dee0180e4a5 service nova] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:02.974123 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-58fd31b4-cbe2-45d6-b370-f0b408bb8f24 req-4958e7b8-38e8-4a15-bb46-8dee0180e4a5 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:02.974548 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [req-58fd31b4-cbe2-45d6-b370-f0b408bb8f24 req-4958e7b8-38e8-4a15-bb46-8dee0180e4a5 service nova] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:02.986092 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.compute.server_external_events [req-58fd31b4-cbe2-45d6-b370-f0b408bb8f24 req-4958e7b8-38e8-4a15-bb46-8dee0180e4a5 service nova] Creating event network-vif-deleted:15aead72-d25a-4849-9e8f-8a9c86d1544a for instance 9070b477-3eca-4c1e-aec3-251afda78787 on hv-cinder-82880 Aug 30 15:01:02.991455 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [req-58fd31b4-cbe2-45d6-b370-f0b408bb8f24 req-4958e7b8-38e8-4a15-bb46-8dee0180e4a5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160795 Aug 30 15:01:02.992227 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 700/1407] 10.222.0.25 () {64 vars in 1317 bytes} [Tue Aug 30 15:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:01:03.020524 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.policy [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28b133b471d64de1b9088e6ab8a4c62d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6ce53558466411292626efed88183b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127176) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:03.028653 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-39a5314f-3c5b-4895-b3cf-2b78bb14faf6 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 200 len: 1220 microversion: 2.1 time: 0.089835 Aug 30 15:01:03.029152 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 708/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:02 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:04.051412 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '>' {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:04.052061 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.compute.api [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] [instance: 9070b477-3eca-4c1e-aec3-251afda78787] Fetching instance by UUID {{(pid=127177) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:04.058780 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.059260 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.059691 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.060427 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Acquiring lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.060876 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.061298 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG oslo_concurrency.lockutils [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Lock "0a8b5f18-5bf8-494b-9cd5-57a6421af099" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.075825 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.wsgi [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] HTTP exception thrown: Instance 9070b477-3eca-4c1e-aec3-251afda78787 could not be found. Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Request method failure captured: Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: request: GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 HTTP/1.1 Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept: application/json Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Accept-Encoding: identity Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Connection: close Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Length: 0 Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Content-Type: application/json Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Host: 10.222.0.25 Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: Openstack-System-Scope: None Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: User-Agent: python-urllib3/1.26.12 Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Auth-Token: gAAAAABjDiTjhTz41CddMIAlcQLTXPlDrziUSj19DS2ZJL3rugiwUkCAqSuPnMnRNss2QPfal_z6fcdjufbXF52q2xY8WyOlpgdyHV19lDGKktvjDsnWVETmLDRTuz-SdYPeti8nZPcG4FulZGjTvUi9nHLHfUQf2InzvvGZBcsB0_b9uXA4DqY Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Id: None Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Domain-Name: None Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Identity-Status: Confirmed Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Is-Admin-Project: True Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Id: default Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Domain-Name: Default Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Id: f6ce53558466411292626efed88183b0 Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Project-Name: tempest-TestShelveInstance-1102396312 Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Role: reader,member Aug 30 15:01:04.077502 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Roles: reader,member Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6ce53558466411292626efed88183b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6ce53558466411292626efed88183b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6ce53558466411292626efed88183b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6ce53558466411292626efed88183b0", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant: tempest-TestShelveInstance-1102396312 Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Id: f6ce53558466411292626efed88183b0 Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-Tenant-Name: tempest-TestShelveInstance-1102396312 Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User: tempest-TestShelveInstance-1102396312-project Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Id: default Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Domain-Name: Default Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Id: 28b133b471d64de1b9088e6ab8a4c62d Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: X-User-Name: tempest-TestShelveInstance-1102396312-project Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: method: > Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: exception: Instance 9070b477-3eca-4c1e-aec3-251afda78787 could not be found. Aug 30 15:01:04.079472 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: action_args: {'id': '9070b477-3eca-4c1e-aec3-251afda78787'} Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: {{(pid=127177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9070b477-3eca-4c1e-aec3-251afda78787 could not be found. Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:01:04.080623 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9070b477-3eca-4c1e-aec3-251afda78787 could not be found. Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9070b477-3eca-4c1e-aec3-251afda78787 could not be found. Aug 30 15:01:04.082489 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: ERROR nova.api.openstack.wsgi Aug 30 15:01:04.084250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: DEBUG nova.api.openstack.wsgi [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Returning 404 to user: Instance 9070b477-3eca-4c1e-aec3-251afda78787 could not be found. {{(pid=127177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:01:04.084250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: INFO nova.api.openstack.requestlog [None req-8dcea91e-c4d3-4818-b941-b3395dcc6982 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787" status: 404 len: 111 microversion: 2.1 time: 0.032849 Aug 30 15:01:04.084250 dv-cinder-828805-5-iscsi devstack@n-api.service[127177]: [pid: 127177|app: 0|req: 701/1409] 10.222.0.25 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:04 2022] GET /compute/v2.1/servers/9070b477-3eca-4c1e-aec3-251afda78787 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:01:04.245076 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: DEBUG nova.api.openstack.wsgi [None req-d134c6ee-509c-4541-8882-bc331b45ebf0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] Calling method '.version_select at 0x7fe6a72bdb80>' {{(pid=127176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:04.273609 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: INFO nova.api.openstack.requestlog [None req-d134c6ee-509c-4541-8882-bc331b45ebf0 tempest-TestShelveInstance-1102396312 tempest-TestShelveInstance-1102396312-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532066080" status: 202 len: 0 microversion: 2.1 time: 0.032590 Aug 30 15:01:04.274209 dv-cinder-828805-5-iscsi devstack@n-api.service[127176]: [pid: 127176|app: 0|req: 709/1410] 10.222.0.25 () {58 vars in 1254 bytes} [Tue Aug 30 15:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532066080 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)